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ABSTRACT 

This final report on the Preliminary Evaluation of 
Planned Variation in Head Start According to Follow Through 
Approaches is a detailed account of the field testing and 
implemenliation activities performed during t:he 1969-1972 period, with 
emphasis on the second and third years. The sections of the report 
are as follows: I. Introduction; II, Background and Overview; III. 
Fall 1969 Testing Activities; IV. Spring 1970 Testing Activities; V. 
Fall 1970 Testing Activities ; VI • Spring 1971 Testing Activities; 
VII. Fall 1971 Testing Activities; and VIII. Spring 1972 Testing 
Activities. Ten appendixes provide: A. through F., Fall and spring 
Communications 1969*1972; G. Supplemental Instructions for Fiield 
Staff, Spring 1971; H. Record of Test Data and Information Forms 
Transmitted to Huron Institute; I. Quizzes and Answer Sheets for 
Spring 1972; and J. SRI Field Supervisor Site Report Forms. Data are 
presented in 18 tables. (DB) 
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I INTRODUCTION 



This final report on the Preliminary Evaluation of Planned Variation 
In Head Start According to Follow Through Approaches, under contract 
HEW-OS-70-134, does not contain any research findings. Rather, It Is a 
detailed account of the field testing and Implementation activities that 
SRI performed during the 1969-1972 period, with emphasis on the second 
and third years. The collected data were transmitted to Huron Institute, 
Cambridge, Massachusetts, which will perform analyses under a grant from 
the Office of Child Development, HEW. The report of the activities and 
the initial findings based on the 1969-70 Head Start year were submitted 
to OCD In May 1971. 

Since this Interim Report contains detailed specifications of the 
measures used, sample selection procedures, the children tested, and the 
field implementation procedures that were applied, a repetition of that 
work Is not contained in this report. References are made, however, to 
the field data collection procedures as they relate to the activities 
pursued in the following two years. 

Copies of the tests used in the six testing periods have been sub- 
mitted to the ERIC Clearinghouse. Anyone wishing copies of any and all 
tests used In the PV evaluation should address ERIC Clearinghouse, Uni- 
versity of Illinois, Urbana, Illinois. Test copies at SRI have been so 
depleted that there no longer exist any full sets that can be given to 
Interested parties. 
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II BACKGROUND AND OVERVIEW 



General 

As part of the continuing effort to explore systematically ways to 
provide children of economically impoverished backgrounds with early 
childhood education that may effectively contribute to their optimal de- 
velopment, a Head Start Planned Variation program was Initiated in 1968 
and became operational in the Fall of 1969. 

The Planned Variation program refers to rather distinct approaches 
to preschool and compensatory education — each consisting of unique as 
well as common features — applied by 11 sponsors* In a variety of geographic 
and soclocultural settings around the country. These alternative approaches 
rest on differing philosophical and psychological premises and employ a 
variety of pedagogical strategies. 

Most of the sponsors had first experimented with and developed their 
programs In experimental preschools for low Income children, modified 
them upward to apply to the Follow Through program, and completed the loop 
by modifying them downward again for the Head Start program. In this 
way clusters of longitudinal studies of articulated compensatory efforts 
were Initiated for children from approximately three through nine years 
of age. 

The Head Start Planned Variation project's objectives are primarily 
twofold: to assess the cumulative Impact on participating children of a 
systematically coherent program from the preschool years through thie early 
elementary school years, and to compare the short-term and long-term ef- 
fectiveness of the various models. 

In July 1968 Stanford Research Institute was selected to conduct a 
nationwide evaluation of Project Follow Through for the U.S. Office of 



For the project's first year, the number of sponsors was eight. In 
the second and third years five additional communities were added under 
the name "Enabler Model," a term descriptive of the use of an OCD con- 
sultant to enable a community to Implement a program of Its own choosing. 
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Education. At the time of the decision to extend some of the Follow 
Through programs into Head Start, SRI had already done extensive work in 
selecting and developing measuring instruments that would reflect the 
varying objectives of the program sponsors, eight of whom became the 
nucleus of the Head Start PV Experiment. 

Furthermore, SRI had assembled a large field staff and organization 
for the testing effort in Follow Through, and the sites where this test- 
ing was being done included a number of the communities in which Mead 
Start was inaugurating the PV programs; therefore, SRI was empl^yt^d to 
conduct the evaluation of the impact of the Head Start PV program. 

An Interim Report* on the 1969-70 evaluation activities was completed 
and submitted to the Office of Child Development (OCD) . Toward the end 
of the 1970-71 testing cycle, OCD instituted a major change in the con- 
duct of the evaluation. All analyses and reporting of the 1970-71 and 
1971-72 data were shifted to Huron Institute and, beginning with the 
Fall 1971 testing, all decisions and specifications of measures to be 
used and samples to be tested were the responsibility of OCD or Huron, 
as delegated. 

Articulation between the Office of Education, Follow Through, and 
OCD was increasingly evident in the attempts to coordinate the testing 
batteries and sample communities to maximize the likelihood that children 
tested in the PV program could be followed during the early school years. 

Over the six testing periods (fall and spring in each of the years 
1969-70, 70-71, and 71-72), evolutionary changes occurred in the' measures 
used, communities tested, and field organization/procedures employed. 
The various tests and measures used in the six testing periods are shown 
in Table 1. Whenever a change in test content, format, instruction, or 
procedure occurred, a prime (') has been added to the test name. The 
exact change can be identified by examination of the final printed torjas. ..\^ 

The communities in which testing was done and the intensiveness of 
data collection in each community also changed over the testing periods. 
An overview of the communities (usually referred to as "sites'*) can be 
seen in Table 2. The level of intensiveness of testing is indicated by 
the roman numerals. A Level I site was usually limited to child/parent 



* 

''Implementation of Planned Variation in Head Start, Preliminary Evalua- 
tions of Planned Variation in Head Start According to Follow Through 
Approaches (1969-70)," Interim Report: First Y3ar of Evaluation, 
Stanford Research Institute, Menlo Park, California (May 1971). 
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lilSTOIlV OF Tilt; TESTS AND ktEASURHS USED 



1971-72 



CO 

P4 



SYU-Ok 30 
NYU-Dk 4A 

Pre- School Inventory 
(PSI ) 

Motor Inhibition (Ml) 
Blnct /Birch 
ElRht-Oloek Sort 



SprinR 

3D 
4A 

PSI 

Ml 

Olnct/Ulrch 
ElKht-Block Sort' 



CIas»roon Inforaatlon CIF 
Form (CIF) 



Teatora log 



Toaehor 
Quoatlonnalro 



Parent 

Quoat lonnalro 

8R1 Claaarooa 
Obaervatlon 
Proeadura (00) 

H8 Dlraetora 
Ratlnga of 
Teaehara (H8D 
ratlnga) 

Sporiaor Rat Inga 
of Teaehara (Sp 
ratlnga) 

Sponaor laple- 
■•ntatlon Report 

H8 Conaultant 
Report* 



Teatera log 

Site Coordlna- 
tnra log (8.C. ) 



Fall 

3B 

•lA 

PSi/Rlrch Scoring 
Ml' 

Blnct/Olrch' 



Ethnic Identity 
Quest lonna Ire (EIQ) 

Children^* Cultural 
A«arene8S Side (OCAS) 



Sprint; 



3D 
•lA 

PSl/olrch Scoring PSi'/Ulrch Scoring' PSl'/lUrch Scoring' 

Ml ' Ml " Ml " 

Olnet/Blrch' 

Eight-Block Sort" Eight-Block Sort'" ElK^t^tilock Sort'" 
EIQ 

CCAS 

WItAV (2 aubteata) WKAT' (full) 
GunpgcmkleH 

ppvt' 

Enumorut Ion 
Bro»n 



PP\T 

Enunerat Ion 
Brown 



Rulevant Redundant 

CUOB 



ITM 



California Proaehool CPSC 
Social Conputlng 
Scale (CPSC) 



CIF' 



CIF 



Schaofor Behavior Schaefer Behavior 
I nvontory Inventory 

cif" cif" 



Teachor Information 
Form' (TIF) 

Aldo Information 
Form (AIF), plua 
Spanlah veralon 

Parent Information 
Form (PIF), plua 
Spanlah veralon 

co' 



TIF - PV 

TIF - CoMparlaona 

AIF' 



PIF 

PIF' ' - Controla 



HSD Ratlnga' 



Sp Ratlnga 



Teatora log 
8.C. log 



HSD Ratlnga 



Sp Ratlnga 



Sponaor laplo- 
maniat Ion Report ' 

US Conaultant 
Report ' 



Teatora log 

8.C. log 



HSD Ratlnga 



Sp Ratlnga 



Teatera log 

S.C. log' 



HSD Ratlnga 



Sp Ratlnga 



118 Conaultant 
Report ' ' 

HSD Evaluation of 
Model and Implementa- 
tion Report 

Teatera log ' 

8.C. log' 



* Head Start Conaultaot Raporta are aade to OCD. 
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Tablo 2 



COMMUNITIES IKVOLVED IN Hit: TESTING 







Comparison 






Tesi 


tlnK I.cvel* 












196 £ 


-70 




1970-71 


1971 


-712 


Sponsor 


Coimnun 1 ty 


Only 


Fall 


Spr ing 


Fa 


1 Spr lnf( 


Fall 






Bu f f 0 lo 












I 


1 




Clcvolond 




III 














Uuluth 




III 


III 


II 


1 III 


I 1 1 


III 




St. Cloud 


Cp 


III 


III 


II 


[ III 








Fresno 








II 


1 III 








Salt Lake 










I I 


III 


I I 




Tacoma 










1 II 


III 


I I 


Tucson 


' Dos Moines (FT) 


Cp 










III 


I I 




LaFayettc 




III 


III 


II 


1 III 


III 


II 




Albany 


Cp 


III 


III 




I III 








Lakeswood 




III 


III 




' I 


III 


I I 




Jersey City 


Cp 


III 


III 












Lincoln 










[ III 


1 1 1 


I I 


Bank Street 


Boulder 


- 






II 


I III 


I 


I 




Tuskegee 




III 


III 




I I 


III 


II 




Wilmington 




in 


III 




I II 


III 


III 




DoLaWar 


Cp 








I II 








Elrolra 










I III 


III 


1 1 I 


Englonann- 


East St, Louis 




III 


III 


II 


I III 






Beckor 


Tupelo 




III 


III 




I III 


III 


III 




E. Las Vegas 












III 


I I 




tar t •* <• tfM<vM« 

w. uus vegas 


Cp 










III 


I I 




Providence (FT) 












III 




Busholl 


Oralbl 




III 


III 




[ III 


I 


I 




Acoina 


qp 


III 


III 












Portagevilie 




III 


III 




[ III 


III 


III 




Carruthersville 


Extra Cp 










III 


III 




Mounds 










I II 


III 


II 


Welkart 


Ft. Walton Beach 




III 


III 


II 


I III 


III 


III 




Pensacola 


Cp 


III 


III 




I III 








Central Oxarks 




III 

III 


III 

III 






I f I 
tit 


1 1 




Greeley 










[ III 


III 


II 




Seattle 










[ II 


I 


I 


Gordon 


Jacksonville 




III 


III 






I 


I 




Jonesboro 










I III 


III 


II 








III 


III 






III 
1 1 1 


f f 
1 1 




Houston 










I II 


III 


II 


EDC 


Washington, B.C. 




III 


III 




I III 


I 


I 




Paterson 












III 


III 




Johnston Co, 




III 


III 






III 


II 


Pittsburgh 


Locks Haven 












III 


III 




Mifflenburg 


CP 
















Montevideo 












III 


II 


REC 


Kansas City 












III 


II 


NYU 


St, Thomas, V,I. 












I 


I 


Enablers 


Puerto Rico 












I 


I 




Newburgh 












III 


II 




Bellows Palls 












III 


II 




Billings 












III 


II 




Colorado Springs 












III 


II 


Control 


Huntsville, Ala, 












II 


n 




San Jose, Calif, 












II 


II 




Sacramento, Calif. 












II 


II 



* So* text tor description of Levels I. II, and III. 
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demographic data, teacher information^ and teacher ratings. A Level III 
site received all tests and measures specified for the test period. 
Level II sites typically were denied the SRI Classroom Observations Pro- 
cedure and mother-child interaction test (8-Block Sort Task). 

The numbers of classes and children tested varied over the test pe- 
riods, as seen in Table 3. Any totals shown can vary according to the 
definitions that are applied. For example, a class of 30 children with 
team teachers is considered as two classes with respect to the class ob- 
servation days assigned to it. The number of children tested on particu- 
lar tests varies because of absences and unacceptable testing cordicions« 
The number of children on whom demogi*aphic information was obtained could 
include new additions to the class who may or may not have been tested 
in the spring according to the testing rules in effect; if a new arrival 
were the only child tested in a class, typically some tests were ad-- 
ministered to prevent the child from feeling excluded from the class ac- 
tivities. Thus, the numbers are representative of the level of effort 
and not a precise accounting in an auditing sense. 



Table 3 

NUMBER OF CLASSES AND CHILDREN TESTED 



1969-70 1970-71 1971-72 



Number 


of 


Head Start communities 




16 




37 


40 


Number 


of 


Sites* 




21 




44 


43 


Number 


of 


classes 




105 




332 


303 


Number 


of 


children 


2, 


047 


5, 


621 


5,551 


Number 


of 


classes tested 




105 




186 


208 


Number 


of 


children tested^ 


2, 


237 


3, 


160 


3,358 



For this table, the entry is the number of testing sites 
considered as separate locations for test administration 
purposes. 

Figures are based on Fall testing. For year totals, the 
figures are approximately double. 



The field staff that hAd to be recruited, trained, and supervised 
changed in siao and composition over the testing periods. The numbers 
of persons Involved are shown in Tablo 4. 



Table 4 

COMPGdITION OF THE FIELD TESTING STAFF (NON-SRI) 



1969-70 



1970-71 



1971-72 



Fall Spring Fall Spring Fall Spring 



Site coordinators 
Site coordinator aides 
Binet testers 
Eight-Block testers 
Eight-Block observers 
Eight-Block trainees 
Auxiliary Battery testers 
Tester aides 
Basic Battery-A tester 
Basic Battery-B tester 
Supplem^tary Battery tester 
Brown testers 
Classroom observers 

Total 



97 



52 
21 



20 

58 
27 



49 
27 



179 



10 
191 



41 
44 

68 



38 
191 



43 

41 

20 
20 
65 



Jt2 
221 



33 
40 



40 
40 



88 

35 
39 

315 



33 
39 



17 
17 



77 
77 
32 
10 
10 

312 



* 

Non-SRI field supervisors. 



Comments 

It would be unrealistic to expect that the implementation of a na- 
tionwide testing program that involved 43 different communities could be 
achieved without some stresses and strains. The testing benefited from 
receiving very honest and forthright comments pinpointing specific anom- 
alies and difficulties from the field supervisors, site coordinators. 
Head Start directors^ and the OCD' staff « Fortunately^ there have been 
no criticisms that could be applied across the country and this encouraged 
SRI as to the efficacy of the field implementation procedures being used. 
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In cases where there had been local difficulties^ sufficient information 
was obtained to enable courses of action to correct the condition or at 
least avoid it during the test period. For examplei there were some in- 
stances where field personnel turned out to be unacceptable to the local 
community even though the local Head Start director had been instrumental 
in selecting the personnel. The changes that were made were made only 
after consultation with the site coordinator and Head Start director so 
that no Unreasonable disruption occurred in the commuhity. The lessons 
learned in the implementation of the Ethnic Heritage tests in the fall 
of 1970 and the Parent Questionnaire for the prior spring support the 
view that it is profitable to inform the community early about details 
of the forthcoming tests and to enjoin them to make their comments and 
criticisms known in sufficient time for accommodations to be made. 

The sections that follow describe the planning and coordination 
needed to implement the specified tests in the required communities. 
Each test period is described separately and, where possible, similar 
headings are used for the convenience of the reader. The description 
of the Fall and Spring (1969-70) testing is an abridged version of the 
description contained in the Interim Report. Appendices A through F 
contain extensive detail about the procedures i.:sed. 

Appendix G contains detailed instructions for the field staff for 
their testing in Spring 1971. Appendix H is a record of all materials 
sent to Huron Institute. Appendix I contains copies of the test quizzes 
and answer sheets used in the Spring 1972 testing. Appendix J contains 
copies of the site report forms used by the SRI Field Supervisors. 



Ill FALL 1969 TESTING ACTIVITIES 



Planning and Coordination 

The extension of the eight Follow Through sponsors' programs into 
the preschool setting of Head Start adds a year to the period in which 
the children's progress can be observed and provides a basis on which to 
determine the effects attributable to earlier entrance into a sponsor's 
program. This integration of effort between. Head Start and Follow Through 
placed a premium ©n Joint selection of test instruments and measurement 
procedures. Some tailoring of the test batteries to specific interests 
of Head Start was necessary to give due recognition to earlier research 
by Head Start and, where feasible, to provide anchor points in such pre- 
vious work. For the coordination to be most effective, Follow Through 
had to have its test batteries delineated early enough to permit the in- 
clusion of specific instruments in the Head Start evaluation procedures. 
Changes in the Follow Through battery of tests were negotiated as late 
as the first week in September, however, thus preventing, optimum coordi- 
nation. 

To achieve a coordinated use of SRI's field testing staff and to 
avoid excessive duplication of travel and training time required an inte- 
grated test schedule. But, in fact, the timing of test periods in the 
two projects at joint locations was most likely to create conflict or 
competition rather than cooperation. The eventual separation of the Head 
Start and Follow Through field logistics resulted in easier planning and 
a greater responsiveness to the needs of both projects. 



Tests and Measures Used 

New York University Early Childhood Inventory Test 

Six of the subtests from the New Yofrk University Early Childhood 
Inventories Project (Coller and Victor, undated)^ were selected. The 
subtests— pre-math, pre-science, prepositions, alphabet, numerals, and 
shape names-*-*had been used in the 1968«»69 Follow Through evaluation as- 
sembled in three forms, each form consisting of one-third of the test 
items selected at random from each subtest. On the basis of the data 
from Follow Through in 1968-69, it was possible to identify those forms 



* A. Coller and J. Victor, *'Early Childhood Inventories Project," (mimeo) 
New York Institute for Developmental Studies, New York University, 
New York (undated). 
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of the subtests that had the best range of responses for potential use 
with the Head Start PV preschoolers and that were predicted to retain 
sufficient range for later use when the children attended Follow Through. 

The subtests covering pre-math, pre-science, and prepositions were 
presented in one booklet (Booklet 3D). In the first year of the Follow 
Through PV evaluation, the pre-math and pre-science subscales that even- 
tually were used for Head Start PV came from Booklet 3A, and the prepo- 
sition subscale came from Booklet 3B. In the remaining three subtests — 
alphabet, numerals, and shape names— the original configuration (Book 4A 
in Follow Through) was used in its entirety. 



Preschool Inventory Test 

The PSI 64-Itein Experimental Edition, developed for Head Start by 
Caldwell and published by Educational Testing Service (ETS),* had been 
part of the Follow Through battery for kindergarten and entering- first- 
grade classes in the 1968-69 SRI evaluation and was scheduled for the 
1969-70 Follow Through, It was also used in the 1968-69 Head Start na- 
t iona 1 a s sessment . 

To reduce the amount of time required for the testing of each child 
in Follow Through, the PSI had been assembled in three forms, each con- 
sisting of a random one-third of the test items; the test was group ad- 
ministered individually to all children. 

Stanford-'Binet Intelligence Scale with Hertzig - 
Birch Scoring 

The Stanford-Binet IQ scores were supplemented with a modified ver- 
sion of the Hertzig-Birch scoring system to provide an indication of 
noncognitive factors that might contribute to IQ scores and that would 
be masked if only IQ scores were considered in the evaluation, and to 
maintain continuity with its use in previous Head Start evaluations* 

The modified Hertzig-Birch scoring system differs from the original 
in that only the last response the child makes to a test item is scored 
and a more concise coding is used. These modifications were made to 



B. Caldwell, "The Preschool Inventory," Educational Testing Service, 
Princeton, New Jersey (1967). 
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enable Stanford-Binet examiners to use the scoring system as they admin- 
istered the Stanford-Binet. 



Motor Inhibition (Maccoby et al,, 1965) * 

The te^tr /procedures used were taken directly from those developed 
by the ETS for its longitudinal study of Head Start children in four ci- 
ties. Although these procedures were slightly at variance with the orig 
inal work of Maccoby and her associates , it was considered desirable to 
reproduce as closely as possible the test conditions of the current ETS 
study. 

The three parts of the test are concerned with different levels of 
muscle group involvement and include the following: a beam-walking task 
which requires gross motor coordination; winding the crank on a toy tow 
truck y which requires small Tnuscle coordination; and drawing a straight 
line using a straight edge, which requires small muscle coordination. 
Each of the tasks was done twice by the child, first at his natural rate 
of speed and then on instruction to do it as slowly as he could. 

Eight Block-Sort Task 

The Eight-Block Sort Task used by Hess and others^ allows investi- 
gation of direct or indirect effects of the Head Start PV programs on 
the styles of interaction between mothers and the'.r children. The task 
involves sorting eight blocks into four groups defined by two criteria. 
The blocks differ according to four attributes— height (tall or short); 
mark (X or 0 painted on the top); color (red, yellow, green, or blue); 
and shape (rectangular or circular cross- section). Only two of these 
attributes are relevant to the sorting cask: height and mark. The 
children were to learn to group th;» blocks of the same height and the 
same mark and to explain the reasons for the grouping^. The four groups 
defined by height and mrrk would be composed of (1) tall blocks marked 
X, (2) short blocks marUed X, (3) tall blocks marked O, and (4) short 
blocks marked O. 



E. Maccoby et al., "Activity Level and Intellectual Functioning in 
Normal Preschodl 'Children/* Child Development , No. 36, pp. 761-770 
(1965). 

R. D. Hess et al., "The Cognitive Environments of Urban Preschool 
Children," Graduate School of Education, University of Chicago (1968) 
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This test was then being used by ETS in its longitudinal study of 
Head Start children in four cities, and the procedures used by ETS for 
the administration of the test were carefully followed. However, the 
scoring of the task differed from the ETS procedure. ETS made tape re- 
cordings of the situations for later analysis of the verbal interactions 
between the mother and the child, whereas the SRI procedure required the 
tester to make tho ratings and Judgments during the test situation. T^pe 
recordings were not made for three reasons: the nonverbal communications 
(e.g., g^estures and facial expressions) could not be derived from tape 
recordings; equipping approximately 80 testers with a tape recorder was 
prohibitively expensive in cost and logistical effort; and the time needed 
to transcribe and code the tapes would have been too great for the budgeted 
resources. 



SRI Classroom Observation Procedure 

The SRI Classroom Observation (GO) procedure is made up of three 
major sections, each covering a different aspect of the class in its daily 
session. The first part consists of a series of observations and ratings 
that are made about every 15 minutes and include a tally of all activities 
going on in the class and of the participants in each activity (the Class- 
room Checklist, or CO), a five-minute systematic recording of all inter- 
actions in a selected activity (Five-Minute Interaction, or FMI), and a 
short set of ratings at the end of each five-minute observation period 
to record the frequency of child and adult behavior not included in the 
FMI (Five-Minute Rating, or FMR). A second part of the observation pro- 
cedure is a separate observation of an outdoor or highly mobile situation 
(00). At the end of the day's observation a set of summary ratings is 
completed, and an inventory of equipment available and used is made, 
along with a sketch and description of the space and physical arrangement. 

Teacher Questionnaire 

The Teacher Questionnaire covered the following areas: 

• Classroom practices with regard to the teacher's responses 
to children's behaving in desirable and undesirable ways, 
allotment of class time to different activities, and methods 
used in teaching academic subjects. 

• Participation in the sponsor's training program and the 
availability and exchange of information and materials on 
the sponsor* s program. (These items relate specifically 
to the problem of program diffusion to comparison classes.) 
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• The use of the TV program, Sesame Street. 

• The Importance of various educational goals for the children. 

• The social behavior of the children as Judged by the teacher. 

• Home visits. 

• Participation of the parents. 

• Materials and equipment availability and use. 

• Teaching experience and background. 

Parent Questionnaire 

A parent Interview Instrument was developed Initially for use In 
SRI's Follow Through evaluation. Its purpose was to provide Information 
about the characteristics and changes In characteristics of families of 
Follow Through and non-Follow Through children to determine If these fac- 
tors might be related to other factors, such as performance In school and 
teacher behavior and attitude. The procedure went through several reviews 
by SRI staff and consultants, PV program sponsors, U.S. Office of Education 
staff, and the OCD Head Start Staff. 

« 

Although the Follow Through parent Information was obtained by Inter- 
views conducted In the parents' homes, such a procedure was not possible 
In the Head Start PV evaluation because of resource limitations. 

The Interview procedure was converted to a Parent Questionnaire for- 
mat, modified to meet the circumstances specific to Head Start; It was 
administered to the mothers who participated In the Spring testing of the 
Eight-Block Sort Task described earlier. This administration was carried 
out by a so-called "parent Interviewer" who also assisted In the scheduling 
of the children In the Eight-Block Sort Task. The Interviewer's task was 
to assist the mother In understanding the Parent Questionnaire Instruc- 
tions and. If Illiteracy was suspected, actually to administer the ques- 
tionnaire orally. Because of the need to keep the administration time 
within a one-hour limit, some shortening of the original home Interview 
procedure used In Follow Through was made. The experiences gained In 
the Follow Through home Interviewing were used In the formating of the 
Head Start Parent Questionnaire. 



Classroom Information Form 

Selected demographic Information about the children and the families 
was obtained through the use of a Classroom Information Form that was 
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distributed at each site tor completion by the teachers and/or Head 
Start directors. These forms were to be available at the beginning of 
the year at the time parents enrolled their children, but in some loca- 
tions the enrollment periods occurred during the summer* The items of 
information called for included: the child* s date of birth, sex, and 
ethnic group; the educational level of the parents and their occupations 
and family income; the previous preschool experience of the child; the 
number of siblings with Head Start or Follow Through experience; and so 
forth. 

The Classroom Inforir.ation Form closely paralleled the demographic 
form used in Follow Through and profited from the earlier comments from 
the sponsors and Head Start. On tho basis of the Follow Through evaluation 
experience, some difficulty was anticipated in obtaining completely filled 
out forms. Where possible, the mothers who participated in the Eight- 
Block Sort Task were asked to verify the information entered in the forms. 

Sponsor Ratings of Teachers 

In May 1970 each sponsor was requested to rate each teacher in his 
program according to how well the teacher had represented the program in 
class. Forms were provided to each sponsor that contained the names of 
each PV teacher whose class was tested. Ratings were to be made on a 
scale ranging from "Barely Acceptable" to "Completely Acceptable." (There 
was also a "Not Acceptable" category.) Ratings were to be made for three 
time periods: October 1, 1969; May 1, 1970; and with a prediction of 
performance for May 1, 1971. 

Head Start Director Ratings of Teache rs 

The Head Start directors were requested to rate the teachers of the 
comparison classes according to how well they performed as Head Start 
teachers. Except for essential word changes, the form was similar to 
the one used by the sponsors. Since the names of the PV teachers were 
also shown on the forms sent to the Head Start directors, their ratings 
were also obtained. 



Sponsor Reports on Implementation and Training 

Detailed information on pre- and in-service training schedules and 
programs was provided by the sponsors, along with critical self-assessments 
on the problems and extent of program implementation. These reports. 
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which were obtained by interview, correspondence , and telephone, also 
covered community, personnel, and coordination difficulties, and their 
impact on the first year of PV program implementation in Head Start, 

Intensive Child Study 

A pilot effort was initiated to study intensively two children from 
one site for each sponsor in order to identify characteristics of experi- 
ence that are significant in the development of the child other than those 
measured in the SRI evaluation. A practical outcome was to be the speci- 
fication of measures and procedures that could be implemented in the na- 
tional assessment. This work was done under the direction of Dr. Laura 
Dittmann, Institute for Child Study, College of Education, University of 
Maryland. The report on these intensive case studies was submitted to 
SRI and transmitted to OCD. 



Test Sample 

The Office of Child Development (OCD), Head Start, selected eight 
of the more widely implemented Follow Through programs and offered one 
to each of two communities in which the program already existed in the 
early school grades under Follow Through support. The Head Start Centers 
that were so approached could either accept or reject the offered program 
but could not use an alternate. The locations in which the Follow Through 
program sponsors elected to offer their programs to Head Start were not 
picked randomly; rather, they generally reflected a sponsor* s preference 
for areas in which implementation of his program was progressing without 
untoward difficulty. The sponsors and the communities in which the pro- 
grams were accepted are shown in Table 2. 

Within the Head Start PV communities, it was next necessary to iden- 
tify with and coordinate a set of comparison groups that would satisfy 
certain requirements of comparability. In five instances it was impos- 
sible to locate comparison classes in the communities in which Head Start 
FV was being implemented, because all Head Start classes in these PV 
communities were sponsored. The communities affected and the off--site 
comparison communities are as follows: 
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Sponsor 



Head Start PV Community 



Off-Site Head Start 
Comparison Community 



Tucson 
Bushel 1 



Nimnicht 



Tucson 



Duluthy Minnesota • 
LaFayette, Georgia 
Lakewoody New Jersey 
Oraibiy Arizona 



St* Cloudy Minnesota 
Albany y Georgia 
Jersey City, New Jersey 
Acoma, New Mexico 



Weikart Ft. Walton Beach, Florida Pensacola, Florida 

There were two criteria for selection of comparison Head Start clas- 
ses* First, the Head Start classes should not be actively influenced 
by the Head Start PV program against which they would be compared, e.g., 
diffusion Que to sharing the same facilities and other factors should be 
minimal* Second, the children should be scheduled to enter non-Follow 
Through public schools the following year so that they could continue to 
be used as comparisons in the follow-up studies* 

Implementation of the Fall 1969 Testing 

The Fall test period was initially scheduled by OCD, Head Start, to 
begin early in the first week of class in each center* Such timing would 
help ensure that the initial scores were as unaffected as possible by 
Head Start experience. The first days in the Head Start classes are full 
of commotion, uncertainties, and excitement as schedules, physical facili' 
ties, equipment, and teachers are brought into order. To avoid the gen- 
eral disruption of the first few days, testing was scheduled to begin the 
second week of class and to be completed in two weeks* 

The starting date for the classes ranged from August 25 to October 
15, 1969, with about half the communities starting right after Labor Day* 
The Fall pupil testing was completed during the period September 8 to 
October 21, 1969* The early testing proved to be very difficult for two 
reasons: (1) the communities were generally severely pressed to accomo- 
date the testing during a period when the Center was still in the process 
of settling into its routine, and (2) the recruitment and scheduling of 
qualified Binet testers in many instances had to be accomplished when 
most of these testers were either on vacation or soon to be busy with 
college classes and registration* Because of these problems, testing 
was one week late in three sites and th^ee weeks late in one site* All 
other sites were tested starting the second week of school. 

The basic testing team consisted of persons with three kinds of 
qualifications* The first was a Binet-qualif ied tester who had proven 
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expertise in the administration of the Stanford-Binet by virtue of com- 
pleting a supervised course of instruction and administering tests under 
formal supervision. The Binet tester also administered the Eight-Block 
Sort Task for assessing mother-child interaction. Supplementing the Binet 
tester was a junior tester who was concerned with the administration of 
the NYU tests (Bk 3D and 4A), the PSI (Bk 5), and the Motor Inhibition 
tests. The term "Auxiliary Battery" is used to describe conveniently the 
tests given by the Junior tester. Augmenting these two people was an 
aide whose tasks were to schedule the children to the Binet tester and 
the junior tester, to check the demographic data on the classroom infor- 
mation forms by consulting with parents who were waiting to participate 
in the Eight-Block Sort, and to care for the child whose mother was being 
instructed in the Eight-Block Sort procedure. 

To ease the introduction of a stranger into the class, extensive use 
was made of locally hired testers and aides. Related to this issue is 
whether testers should be of the same ethnic background as those tested. 
It is possible that such matching would be advantageous to data collection 
efforts, but the ability to establish good rapport rapidly and consistently 
was considered more pertinent to effective testing than ethnic group af- 
filiation. Although records were kept of the tester* s age, sex, educa- 
tional level, ethnic affiliation, and administrative proximity to the 
Head Start programs, these data have not be examined at this time in 
terms of their possible relationship to the pupils* test performance. 

The junior tester and the aide were trained in their procedures by 
the Binet tester for one or two days (or longer if necessary) to gain 
proficiency in their procedures. Each Binet tester attended one of sev- 
eral coordination and training sessions conducted by SRI staff or field 
supervisors. The field supervisors were non-SRI personnel who were 
skilled and experienced in testing and test procedures; many held appoint- 
ments as assistant or associate professor in colleges of education or 
departments of psychology. In preparation for the field work, these field 
supervisors attended a coordination meeting at SRI during August 1969. 
Training sessions for the testers were conducted at various locations 
around the country. 

During the 1968-69 Follow Through evaluation, training sessions were 
held that included school district representatives, and these sessions 
proved to be a useful way to share with school personnel the purposes, 
means, and requirements of the testing and evaluation program. A similar 
view was held about the training sessions for the Head Start evaluation. 
The OCD Head Start staff made it possible for local persons to be reim- 
bursed for travel and to receive a per diem while attending the training 
sessions. 
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It proved, however, to be very difficult to run training sessions 
when the audience was made up of persons experienced in testing techniques 
and also of parents or other community members who were well versed in 
the administration and objectives of Head Start but not in testing. 
Some technical discussions may have been very unsettling to the community 
people who were not fully aware of the content and purpose of all of the 
tests involved. The training session agenda was revised for the last 
session in an effort to avoid the apparent confusion on the part of com- 
munity members who had attended previous sessions. The revision permitted 
the whole group to participate in general matters but later separated 
the testers into a technical detail work session and the community persons 
into a separate meeting to discuss the nature and meaning of the tests 
and the evaluation program without the distraction of the issues that 
were pertinent to detailed testing procedures. This agenda appeared to 
be much more productive than the initial one. Community participation is 
important, and the agenda should be responsive to these needs so that a 
full understanding of the evaluation activities can be carried back to 
the communities. 

The primary goal for the training sessions was to instill in the 
testers the need to follow explicitly the test procedures so that the 
conditions of testing would be standardized. Each tester was provided 
with a tester* s log in which he was to enter any anomaly in testing pro- 
cedures • 



Tests Administered 

The numbers of tests completed in Fall 1969 are shown in Table 5. 



Table 5 



TESTS ADMINISTERED IN 1969-70 



Fall 1969 



Spring 1970 



NYU Tests (Booklet 3D) 
NYU Tests (Booklet 4A) 
Preschool Inventory 



Classroom Information Forms 



Motor Inhibition Test 
Eight-Block Sort Task 



S t anf or d -*B ine t 



2,647 
2,239 
2,229 
2,209 
1,256 
2,231 



2,135 
2,125 
2,130 
1,107 
2,135 



978 



815 
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IV SPRING 1970 TESTING ACTIVITIES 



Planning and Coordination 

To tighten up quality control procedures of the field activities, 
some changes in the test organization were instituted for the Spring 
testing. The basic change consisted of hiring site coordinators for 
each location. These site coordinators were qualified in Binet testing 
and were responsible for controlling and coordinating all the test activ- 
ities in their locations* Their specific responsibilities included the 
selection and approval of the Binet testers, the Auxiliary Battery 
testers, and the Eight-Block Sort testers who were to work with them. 
They, along with the Head Start director, assisted in the identification 
of the trainees who were to participate in the CO training procedures, 
A five-day orientation meeting was conducted at SRI to ensure that all 
the procedures were fully understood and would be standardized among 
the site coordinators. 

Each site coordinator had under his iiranediate Jurisdiction a minimum 
of one Binet tester, an Eight-Block Sort tester, an Auxiliary Battery 
tester, and a second junior tester called a "parent interviewer." The 
parent interviewer was responsible for scheduling the parents for the 
Eight-Block Task and, while the mother was waiting for her participation 
in that task, for administering a parent questionnaire to the mother. 
The parent interviewer *s presence was necessary to ensure that the mother 
understood the questions being asked; if the mother could not read, the 
parent interviewer administered the questionnaire in verbal form. 

To reduce the number of outsiders testing the children, the Eight- 
Block Sort testers and classroom observers were locally recruited. How^ 
ever, the lack of qualified Binet testers made it necessary to use several 
who were moved into those sites where Binet testes could not be found. 

In those locations where possible difficulties in test implementa- 
tion were indicated, SRI staff visited the projects to give support and 
counsel to the site coordinators. 

Spring testing was conducted during the three-week period beginning 
May 4, 1970, The closing day for the Head Start centers ranged from the 
end of May until late summer, with some year-round programs in continuous 
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operation except for a brief interval in July or August. The scheduled 
test period avoided the closing activities of the last week of clas*^ in 
the case b? centers that terminated early. Sufficient testers were ised 
in each ..combiunity to complete the testing within the three-week period. 
The classroom observations were conducted during the first three weeks 
of April 1970. 

Implementation of the Spring 1970 Testing 

The periods of testing are shown by week in Table 6. The first day 
of class ranged from August 25 in Site H to November 3 in Site C. In 
the case of the off-site comparisons for C and J, there was a difference 
in class-starting date of seven and six weeks, respectively. Testing 
was to be initiated the second week, but some delays occurred because of 
difficulties in obtaining testes (for example, in Site A) or because 
the classes were not fully functioning during the first week of school. 
The classroom observations were scheduled for a three-week period in 
April 1970. The observations in Site D were delayed one week because of 
scheduling difficulties. The pupil post-testing period was accomplished 
during May 1970 except for Site I, which liad an early closing date, and 
for the comparison class in Site J, which were delayed because of a 
scheduling problem of Binet testers. The representations in Table 6 are 
approximate because the symbol for testing (T) is entered even though 
only the first or last day(s) of a week was (were) used. The delay in 
fall testing at Site J was caused by the need to replace the testing 
personnel . 

Test Administered 

The number of tests completed in Spring 1970 are shown in Table 5. 




Table 6 



TESTING SCHEDULE 
1969-1970 




Legend: • First week of class 

T - Weeks in which teatlng occurred 
0 - Clsssrooai observat Ions 
Offoslte coMparlscm classes 



Site identification cannot be given because such infomation would 
help identify locations evaluated in the Interim Report and thus 
expose the coanunity receding systen used. 
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V FALL 1970 TESTING ACTIVITIES 



Planning and Coordination 

The composition of the Fall 1970 test battery was predicated on two 
major considerations: maintaining a comparability and integration with 
the test battery being used in the Follow Through evaluation and maintain- 
ing a continuity with the experiences from the Head Start Planned Varia- 
tion evaluation of the first year and related studies. 

Tests and Measures Used 
Preacademic Tests 

The NYU Early Childhood test battery was represented by Booklet 3D, 
which includes the subscales pre->science , pre-math, and prepositions, 
and Booklet 4A, which includes numerals, alphabet, and shape names. Begin- 
ning in 1968 these subscales were assembled into three randomly generated 
forms known as 3A, SB, 3C, and 4A, 4B| 4C in an effort to reduce the over- 
all testing time for any child in the SRI Follow Through Evaluation Project. 
One-third of each class took one of the forms. A, B, or C. In the fall of 
1969, Follow Through had altered its test battery and arranged the NYU 
tests in two equivalent forms, G and H. Since the subtests contained in 
Booklet 3 proved to be too easy for the Spring assessment of first graders, 
this booklet was eliminated from the Follow Through battery although it 
was retained as appropriate for the Head Start Evaluation. For the Head 
Start test battery in the fall of 1969, however, a careful examination 
was made of the test results at the kindergarten level in Follow Through. 
From these data it was concluded that the best sc&les for Booklet 3 could 
be assembled from form 3A and 3B and these were combined to comprise 
Booklet 3D. The subscales in Booklet 4 showed a sufficient ceiling through- 
out the various forms that it was possible to select 4A for inclusion in 
the Head Start battery. 

In the fall of 1970 the Follow Throug^i test package was reconstituted 
to reduce the number of individual types of tests; items or subtests that 
were common in nature were combined. For example, a linguistics area was 
identified through analyses made within the Follow Through data and sub- 
stantiated through factor analysis. In Booklet 4 of the NYU Early Child- 
hood tests, 21 items had been included in the Follow Through Fall test 
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battery* Twelve of these items are concerned with the alphabet subtest 
and of these 12, five derive from Booklet 4A used in the Head Start 
battery* The surviving items from Booklet 4A that were included in the 
Follow Through and the Head Start battery for fall 1970 are shown in 
Table 7. 



Table 7 

NUMBER OF NYU SUBTEST ITEMS UNDER FOLLOW THROUGH 
AND HEAD START 



NYU Subtest 



Booklet Alphabet Numerals Shape Names 



1968-69 



1969-70 



1970-71 



4A 
43 
4C 

4G 
4H 

K2 
K3 
F2 



9 
9 
9 

13 
13 

12 
0 
12 



6 
6 
6 

9 
9 

0 
9 
8 



3 
3 
3 

0 
0 

0 

0 
0 



1969-70 and Fall 
*70 Bk 4A (Head 
Start PV) 

Number of items 
common to Follow 
Through and Head 
Start 



6 



The items select^ for the Follow Through Booklet 4 were those that 
had the highest correlation with the factor-grouping scores. The presence 
of items common to both the Head Start and the Follow Through tests can 
assist in tracking the progress of the students as they emerge from Head 
Start and enter the Follow Through program. A .choice had to be made be- 
tween substituting the current Follow Through test items for Booklet 4A 
of the Head Start evaluation in 1969-70 or retaining Booklet 4A in its 
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entirety to tnaxltnlze the equivalence of the test results In two successive 
Head Start evaluations. The latter course of action was Judged to be the 
more useful one for the particular benefits of the current Head Start 
evaluation. 

No changes were made In Booklet 3D and, although It was no longer 
used in Follow Through because of the tendency of children to top out, 
it was retained for Head Start. 



Cognitive Development 

Preschool Inventory (PSI) Test— The 1968, sixty-four-item version 
of the PSI used in the 1969-70 Head Start evaluation was retained in its 
entirety for the current year. In Follow Through, although all the items 
were being administered, they were spread through several different test 
formats so that the various collections of test items could retain the 
homogeneity desired for Follow Through. 



Stanford-Blnet Intelligence Scale — In addition to the normal scoring 
of the Binet, a Hertzig-Blrch Response Style coding was used. It is de- 
scribed below. 



Motivational/Developmental Tests 

Motor Inhibition — Several dissatisfactions had been voiced about the 
use of the Motor Inhibition tests in the ETS evaluation by Dr. Virginia 
Shipman and from SRI's experiences of the previous year. ETS had diffi- 
culty with the truck pull because of mechanical troubles, but this was 
not the case in the SRI evaluation in which the winding mechanism had 
been improved so that it would function effectively. Both ETS and SRI 
observed that in the beam-walking*test the demonstration trial made by 
the tester tended to set the tempo for the child's first trial. And 
finally, the scoring of the line drawing seemed to have a great deal of 
inaccuracy because of the premium placed on stopwatch handling by the 
testers for an event that took but a few seconds to be completed. 

These objections were overcome in very practical ways. The demon- 
stration walk by the tester was eliminated to prevent establishing a 
tempo for the children, and more adequate instruction to the testers on 
the operation of stopwatches was incorporated to eliminate the past dif- 
ficulties in obtaining line drawing times. Although these corrections 
were made, they avoided the main difficulty of the Motor Inhibition tasks 
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that concerned the establishment of whether a child had understood the 
concept of "slowly/* Two preliminary items weire added to the Motor 
Inhibition tests that required the child to indicate whether he under- 
stood the concept of ''slower/' It was done by the tester presenting the 
child with two different tasks, one done slowly and one done more quickly. 
The order of the "slower" presentation was alternated, and if the child 
failed to get each of these items correct, it was assumed that he did not 
understand the slow concept. These test scores can thus be processed 
separately or ignored. During the course of the Fall testing the SRI 
Field Supervisors observed that in many instances the tester presented 
the practice items in such a way that it was almost impossible for a child 
to discriminate a slow trial. It was subsequently decided to include all 
the Motor Inhibition scores in the data bank so that two summaries of the 
test performance could be examined: the first to include all children 
who took the test and the second to include only those children vlio gave 
correct responses to the two predetermining (or practice) items. 

Some consideration was given to altering the administration procedures 
for the Motor Inhibition test, but since ETS had greatly reduced its eval- 
uation program, the procedure specified by Dr. Maccoby et al«* was fol- 
lowed closely. She reported reliabilities of the "slowly" trial of .77 
for line drawing, .81 for truck pull, and .87 for beam walking — cogent 
^ reason for following the procedures established by Maccoby. 



Birch Scoring of the Binet — Before the Fall testing, a very profit- 
able coordinating meeting was held with Ruth Silverstein from UCLA who 
had been involved in the previous uses of the Birch scoring in Head Start 
evaluations. Her counsel helped confirm the appropriateness of the use 
of the Birch scoring, and she was in agreement that the supplementary 
worksheet that had been prepared by SRI and been given copyright release 
approval by the publisher was an effective and accurate means for imple- 
menting and recording the Birch scoring procedures. Parenthetically, it 
might be mentioned that some of the more useful applications of the Birch 
scoring were expected to come from its application to other tests in the 
Head Start battery in addition to the Binet. These applications and 
procedures were to be considered in the Spring test period. 
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Ethnic Heritage Tests 



Ethnic Heritage tests were developed for SRI by Dr. Edward Barnes 
for black children and by Dr. Manual Ramirez for Mexican-American children. 
The proofs of these tests were not received until the very last moment 
because of an accident to the graduate student working for Dr. Barnes and 
the pretest effort associated with Dr. Rameriz* work. 

Copies of the tests for black children , Children's Cultural Awareness 
Scale (CCAS) y and for Mexican-American children. Ethnic Identity Question- 
naire (EIQ) f were sent to each Head Start director with a covering memo 
soliciting advice on the appropriateness of administering the tests in 
her community (a copy of this memo of September 4, 1970, is shown in 
Appendix C) . Approximately half the Head Start directors, after consul- 
tation with their PAC chairman, concurred in the desire to have the tests 
administered to the children. The communities that finally administered 
the Ethnic Heritage tests are shown in Table 8. 

Classroom/Parent Demographic Information 

The Classroom Information Form was slightly modified from the first 
year to avoid some difficulties in administration experienced at that 
time. It provided information similar to that gathered in 1969-70 in 
Head Start and Follow Through and paralleled the form used in Follow 
Through . 

California Preschool Social Competency Scale 

This test is a set of ratings on 43 different traits that each PV 
and comparison teacher made on the children in her class during the 
testing period. 

Classroom Observation Procedures 

It was initially proposed that the SRI Classroom Observation Pro- 
cedure be used in three PV and three comparison classrooms in each of the 
Level II land Level III communities. The number of classrooms to be ob- 
served was raised from three to four (maximum), i.e.', to observe each 
class in which pupil testing was done, because the percentage increase 
in the cost of observing an additional class was minimal after the jex- 
penses of the training and various logistical efforts had been committed* 
In view of s0|ne planned savings in the training costs projected in Aug- 
ust 1970 y the plan for four classes was incorporated with no additional 
costs being incurred by the contract. 
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Table 8 

COMMUNITY TESTING LEVELS FOR FALL 1970 



Sponsor 


Code 


Community 


Level 


CCAS EIQ 


Nlmnlcht 


02.02 


Buffalo 


I 






02.04 


Duluth 


III 


X X 




tt 


St. Cloud 


III 






02.05 


Fresno 


III 


X X 




02.09 


Salt Lake 


I 






02 . 13 


Tacoma 


II 


X 


Tucson 


03.08 


LaFayette 


III 






tt 


Albany 


III 


X 




03.09 


Lakewood 


I 






03.16 


Lincoln 


III 




Bank Street 


05.01 


Boulder 


III 






05.10 


Tuskegee 


I 






05.11 


Wilmington 


II 


X 




ti 


DeLaWar 


II 


X 




05.12 


Elmira 


III 


X X 


Becker & 


07.03 


E. St. Louis 


III 




Engl em an n 


07.11 


Tupelo 


III 






07.14 


E. Las Vegas , NM 


II 


X 




It 


W. Las Vegas , NM 


II 


X 


Bushel 1 


08.02 


Oraibi 


III 






11 


Acoma 


III 






08.04 


Portageville 


III 






08.08 


Mounds, 111 . 


II 




Weikart 


09.02 


Ft; Walton Bch 


III 






It 


Pensacola 


III 


X 




09.04 


Central Oz 


I 






09.06 


Greeley 


III 


X 




09.10 


Seattle 


II 


X X 


Gordon 


10.01 


Jacksonville 


I 






10.02 


Jonesboro 


III 


X X 




10.07 


Chattanooga 


III 


X 




10.10 


Houston 


II 
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Table 8 (Concluded) 



Sponsor 


Code 


Community 


Level CCAS 


EIQ 


EDC 


11.05 


Washington 


III X 


X 




11.06 


Paterson 








11.08 


Johnston Co 


III 




Pittsburgh 


12.03 


Lock Haven 


III X 


X 




It 


Miff lenburg 


III X 


X 


REC 


20.01 


Kansas City 


III 




N.Y.U 


26.01 


St. Thomas, VI 


III 




Enabler 


27.04 


Billings 


II X 


X 




27.05 


Colorado Sp 


II X 






27.03 


Bellows Falls 


II X 


X 




27.02 


Newburgh 








27.01 


Puerto Rico 






Fall 


1970 


besting done for Levels 


I , II, and III 










Testing Level 








Tests 


I II III 





Classroom Information Form 

Calif. Preschool Social Competency Scale 

Auxiliary Battery 

NYU (Bk 3D, 4A) 

PSI (Bk 5) 

Motor Inhibition 
Ethnic Heritage Tests 

Children* s Cultural Awareness Scale 

Ethnic Identity Questionnaire 
Classroom Observations 
Stanford-Binet with Birch Scoring 



X 
X 



X 
X 
X 



X 
X 
X 



X X 



X X 
X 



Note: "Off-site" conmiunities are marked with in the code column. 
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On the basis of the experiences of last spring and the analyses made 
for the first year report, some slight modifications and additions were 
made to the Classroom Observation procedures. In view of the vast amount 
of data collected during the course of these observations, an auto?:>r«ted 
procedure for data processing was Instituted. Through the services of 
the National Computer Systems, Incorporated, Minneapolis, Minnesota, a 
procedure for optical scanning of the Classroom Observation records was 
planned, developed, and Implemented. The classroom observation procedures 
were used identically for Head Start and Follow Through, and the prepara- 
tion costs were shared equitably. 

Intensive Child Studies by the University of Maryland 

The subcontract with the University of Maryland for 1969-70 for the 
Intensive study of selected children as requested by OCD was extended for 
1970-71. A very slight delay was experienced in the initial round of 
interviews because of the delay in approval of the amendment to the SRI 
contract that included funds for the University of Maryland effort. How- 
ever, in order not to unduly delay the initiation of this effort, the 
Institute for Child Study at the University of Maryland went ahead with 
its first round of interviews. As of December 9, 1970, the financial 
arrangements with the University of Maryland were completed. 

The communities that were selected for the intensive child study 
were as follows: 



Sponsor 



Community 



Level 



Nimnicht 



Duluth , Minnesota 
Lincoln , Nebraska 
Wilmington, Delaware 
E. St. Louis, Illinois 
Oraibl , Arizona 
Greeley , Colorado 
Chattanooga, Tennessee 
Washington, D.C. 
Lock Haven, Pennsylvania 
Kansas City, Missouri 
St. Thomas, Virgin Islands 
Colorado Springs, Colorado 
Bellows Falls, Vermont 



III 
III 
II 
III 
III 
III 



Tucson 
Bank Street 
Bee ke r -Eng 1 emann 
Bu shell 



Weikart 



Gordon 



III 



EDC 

Pittsburgh 



REC 
NYU 



Enabler 



III 
III 
III 
III 
II 
II 



A report on this work was received and submitted to OCD. 
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Test Sample 



From the visits made by OCD Head Start staff during May 1970, reports 
were available for each of the Head Start PV communities on the expected 
number of centers, classes, and children and their ages and ethnic back- 
ground. At the suggestion of OCD, follow-up telephone calls were made by 
SRI in June and July to obtain the most recent information possible so 
that the classes to be tested could be selected and comparison groups 
could be identified. Because of a lack of match by age and ethnic back- 
grounds in some communities, it was necessary to make double duty of 
specific comparison groups. From the data available from the various 
PV communities, class selections were made (up to a maximum of four PV 
and four comparison classes) wherein the age and racial makeup were as 
nearly similar as possible. Where practical, random selection procedures 
were employed to select the classes for testing, but the opportunities 
for employing random selection procedures were very restricted. The first 
summary thus completed showed that slightly more than 70 percent of the 
children were black, but, since this was considerably greater than the 
proportion of black children in Head Start nationally, OCD required SRI 
to modify this sampling to achieve more nearly a 50-percent maximum fig- 
ure for black children. The revised sample and expected characteristics 
were sent to OCD in the memo on the Progress of the Fall Testing, dated 
September 28, 1970* 

Both the Head Start directors and the Head Start consultants, were . 
very effective in communicating the problems concerning candidate com- 
parison groups in time to respond to these considerations. Two examples 
are illustrative. In Colorado Springs (an Enabler Model) the guidance by 
both the Head Start director and Jean Randlett (Region VIII) prevented 
having a confounded comparison. In Seattle it was learned with chagrin 
that again Weikart was distributing his program throughout the area, and 
thus the initial comparison groups that were identified turned out to 
be under the influence of that prpgram. Attempts were made to use the 
Satellite program, the Neighborhood House Program, and KAMP centers, but 
each of these was involved with the Englemann-Becker program. The site 
coordinator in Seattle found a set of comparison classes being run under 
the model cities program (Sadies Day Care) that were free of the Englemann 
Becker influence. 



Off-Site Comparisons 

A comparison group is ^designated as off -site when (1) there is a 
different Head Start director and separate site coordinators, as found 
in St. Cloud, Minnesota, Albany, Georgia, Acoma, New Meiri'/o^ and 
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Pensacola, Florida; and (2) there Is a different Head Start director , but 
the PV community Is sufficiently close that the one site coordinator and 
the testers can conveniently cover both places, as found In De La War, 
Delaware, W. Las Vegas, New Mexico, and Mlf f lenburgh , Pennsylvania. 



Testing Levels for the Communities 

The communities were assigned to one of three levels of testing. 
Level III communities received the whole test battery and data collection 
effort. Level II received all but the Blnet and the Birch scoring. 
Level I received no pupil testing and or ly the Classroom Information 
Forms and the California Preschool Social Competency Scale were adminis- 
tered. Table 8 shows the- levels of each of the comnunities and the com- 
position of the tcc:t battery for each of the levels. 

The number of PV communities and off -site comparisons in each test 
level differed slightly from tht> basis used in the July 23, 1970, pro- 
posal. The expected and actual numbers of communities in these categories 
were as follows: 



Expected Actual 

Testing PV Off-Site PV Off-Site 

Level Communities Comparisons Communities Comparisons 

I 12 0 8 0 

II 8 0 11 2 

III 12 «5 -H -1 

Total 39 5 37 7 



Implementation of the Fall 1970 Testing 

Selection and Training of the Field Organization 

To achieve the best possible coordination, training, and supervision 
of the testing personnel, site coordinators were identified for each of 
the communities involved in the PV evaluation (37 PV plus 4 of the off- 
site comparison commuhitijPs) . Each Head Start director was asked to 
recommend candidate site coordinators who were members of the community, 
who were predicted to be able to work within the context of the Head Start 
programs in the community, and who satisfied the minimum requirements 
established by the project team. Each candidate's credentials were then 
reviewed by the project team. On return to their communities after 




J 



their training session, the site coordinators were to locate the neces- 
sary number of Auxiliary Battery testers , Binet testers, and the Classroom 
Observer. To assist them, SRI provided the site coordinators with names 
of testers >^o had been employed in 1969 and who had performed satis- 
factorily. 

Since the Job specifications for the site coordinators did not include 
Binet testing qualifications required by OCD in the spring of 1970, it 
proved eminently easier to fill the positions of the site coordinators, 
especially in those areas where Binet testers did not exist. One dis- 
advantage of the level of professional preparation of the site coordi- 
nators used in Fall 1970 testing was the general lack of qualification 
in early childhood education, and, although this would appear to be a 
desirable quality and one which OCD Head Start has enjoined SRI to satisfy, 
the availability of such qualified people is limited considering the re- 
muneration that could be offered. In any event, it was imperative that 
the site coordinator be able to train and manage a field team — traits not 
always found in child specialists. 

The training and coordination session for the site coordinators was 
held in Menlo Park on August 17-19, and a second session was held in 
Colorado Springs on September 18-19 for the Enabler Model site coordi- 
nators who could not be identified in time for the Menlo Park meeting. 
The Billings, Montana, Head Start Center delayed its opening until Octo- 
ber 28 because of its need to resolve some administrative problems in the 
community, and the Newburgh, New York, Head Start Center had not been 
scheduled for coordination meetings with the Enabler consultant until 
September 14, even though the children had started their classes before 
that. Scheduling difficulties prevented the site coordinator from Nev/burgh, 
New York, from attending the makeup session in Colorado Springs, and she 
was subsequently trained by one of the SRI project team Field Supervisors 
during September. In St. Cloud, SRI provided the site coordinator. 

Training for the Binet testers occurred in two locations: in Atlanta 
on August 31 and in Chicago on September 2. These sessions required one 
full day for a review of the Head Start evaluation procedures and detailed 
instructions on the application of the Birch scoring procedures as applied 
to the Binet. 



The classroom observer training was carried out during three different 
weeks: beginning September 14 in New York, September 21 in Atlanta, and 
September 28 in Denver. The communities whose Binet testers and class- 
room observers attended these various training sessions are shown in Table 9. 
For the classroom observer training, a whole week of instruction was neces- 
sary. On the second and fourth day of the training week, the observers 
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Table 9 



TRAINING SESSIONS FOR FALL 1970 



Locat Ion 



Blnet 



Sponsor Code 



Nlmnlcht 



Tucson 



Bank Street 



Becker and 
Englemann 



Bushell 



Welkart 



Gordon 



EDC 



REC 

N.Y.U. 
Enabler 



02.02 

02.04 
ft * 

02.05 
02.09 
02.13 

03. OR 
II 

03.09 
03.16 

05.01 
05.10 
05.11 
II 

05.12 

07.03 
07.11 
07.14 



08.02 
II 

08.04 
08.08 

09.02 
II 

09.04 
09.06 
09.10 

10.01 
10.02 
10.07 
10.10 

11.05 
11.06 
11.08 



Pittsburgh 12.03 



20.01 

26.01 

27.04 
27.05 
27.03 
27.02 
27.01 



Classroom 
^bs e rva 1 1 ons 
DEN 



Community 


Level 


ATL CHI Local 


NYC ATL 


Buffalo 


I 






Duluth 


III 


X 


X 


St. Cloud 


III 


X 




Fresno 


III 


X 




Salt Lake 


I 






Tacoma 


II 






LaFayette 


III 


X 


X 


Albany 


III 


X 


X 


Lakewood 


f 
1 






Lincoln 


¥ IT 
111 






Boulder 


III 


X 




Tuskegee 


I 






Wilmington 


II 






nol oWov* 
UeLtHlf BF 


J J 




V 
A 




III 






E. St. Louis 


III 


X 


X 


Tupelo 


III 


X i 


X 


d. LiHB VBgHS| nill 


J J 






n. LiBo vegHS| nra 


T T 
1 1 






Oraibi 


III 


X X 




Acoma 


III 






Portageville 


III 


X X 




Mounds, 111. 


II 




X 


Ft. Walton Bch 


III 


X 


X 


Pensacola 


III 


X 




UeuLFHl 


I 








III 


X 












Jacksonville 


I 






Jonesboro 


III 


X 


X 


Chattanooga 


III 


X 


X 




II 






Washington 


III 


X X 


X 


Paterson 


II 




X 


Johnston Co 


III 


X 


X 


Lock Haven 


III 


X 


X 


Mifflenburg 


III 






Kansas City 


III 


X X 




St. Thomas, VI 


III 


X 




Billings 


II 






Colorado Sp 


II 






Bellows Falls 


II 




X 


Newburgh 


I 






Puerto Rico 


I 






CHI s Chicago 


NYC « 


New York City DEN 


= Denver 



X 
X 



Ditto marks indicate off-site communities. 
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entered Head Start classes for actual observation of ongoing Head Start 
programs and Immediate review following this observation* Two Important 
features of the Classroom Observation training sessions merit comment: 
the first Is that each attendee must commit to memory the 36 codes that 
are used In the Classroom Observation procedure {tnd each must be tested 
and checked out by the site coordinator before her attendance at the 
training session. During the last day of the training a final examination 
Is given to the trainees and they must score at an 80-percent level of 
agreement with the established coding standarJ on the final examination 
test tape to qualify as observers for the Head Start evaluation. Sinc^ 
the financial investment in and the personal involvement of the classroom 
observer trainee is huge, a preliminary examination is arranged on the 
third day of the training session to identify those who need specific, 
intensive instruction before! the final examination because, wich the tight 
test schedule, it is almost Impossible to arrange for a substitute to be 
trained • 



Field Supervision by the Project Staff 

One of the most important activities in which the project staff 
engaged was the personal supervision of the procedures and environment 
of the testing in each community early in the test program. To imple- 
ment this objective several of the project staff became roving ambassadors 
from Menlo Park and attempted to appear in each community during the first 
and second days of the implementation of the testing to make a final check 
on the efficacy of the test procedures, handle any difficulties of com- 
munity coordination, and, most importantly, represent to the Head Start 
director and the community the image of the project team at SRI in Menlo 
Park* This last role was a most important function of the trips made by 
the field supervision staff because, until someone from SRI appeared in 
the community, all the arrangements had been made on the faith of phone 
calls and memoranda* 



Test Schedule 

The periods when testing occurred in each site are shown in Table 10. 



Tests Administered 

The number of tests administered to the children in the 43 communities 
is shown in Table 11. The numbers entered under Classroom Information 
Form indicate the maximum number of children that it was possible to 
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Table lU 









- FALL 


1970 TESTING DATES 
















> 








Aug Sept 






Oct 




Ni>V 


SKI 


Spiiniior 


C d 


Conmuni ty 


Level 


31 H JLJ 21 'JH 


5 


11 


19 


26 




Visit 


Ntmnicht 


U2.02 


Buffalo 




S 


















02, 04 


Duluth 


III 


S T 








0 






cs 




• 


St. Cloud 


III 


T 






0 








cs 




02.05 


Fresno 


III 


T 






0 








Pll 




02.09 


.la It Lako 




.S 


















U2 . 13 


Tacomn 




T 




0 










PB 


Tucfiun 


03.08 


LoFayotto 


1 1 1 


T 


0 












OS 






A Ibany 


III 


T 








0 






cs 




03.09 


Lakowood 


I 






s 














03.16 


Lincoln 


III 


T 




0 










PB 


Bank St root 


05.01 


Bou Ider 


III 






T 








0 


AS 




05.10 


Tuskogoe 


1 


H 


















05.11 


Wilmington 


II 




T 








0 




OS 






OoLaWar 


" 


T 








0 






BS 




05. 12 


Elnlra 




T 




0 










KE 


Bockor It 


07.03 


E. St. LoulB 


III 


T 


0 












CS 


Englonann 


07. 11 


Tupolo 


III 


T 




0 










KE 




07 . 14 


c . vogas , fw 


[[ 


T 








0 






AS 






W. Las Vogas, NH 




T 


0 












AS 


Bushol I 


08.02 


Oralbl 


III 


T 


0 


















Acona 


III 


T 








0 






AS 




08.04 


PortagevlIIe 


III 






T 








0 


KE 




08.08 


MUUllUB 1 111. 




T 




0 










C8 


Weikort 


09.02 


Ft. Walton Bch 


III 


T 




0 










8S 






Ponaacola 


III 


T 


0 












BS 




09.04 


Central Oz 


I 


S 


















09.06 


Greeloy 




T 






0 








KE 




09. 10 


Seattle 




T 






0 








PB 


Gordon 


10.01 


Jacksonville 




S 


















10.02 


Jones bo ro 




T 






0 








CS 




10.07 


Chattanooga 




T 






0 








CS 




10.10 


Houston 




T 




0 










AS 


EDC 


11.05 


Wsshlngton 




T 








0 






BS 




11.06 


Pateraon 




T 








0 






KE 




11. OB 


Johnaton Co 




S T 








0 






KE 


Pittsburgh 


12.03 


Lock Haven 




T 


0 












KE 






Mlffienburg 




T 






0 








KE 




20.01 


Kansss City 






T 








0 




CS 


N.Y.U. 


26.01 


St. ThoaaSt VI 




8 




T 








0 


KE 


Enabler 


27.04 


BlUlnga 














T 


ot 


CS 




27.05 


Colorado Sp 




T 




0 










KE 




27.03 


Bellowa Falla 








T 








0 


KE 




27.02 


Newburgh 




S 














KE 




27.01 


Puerto Rico 




S 

















Level 

i 11 ill Total 

Projecta 8 11 18 37 

Off-*Slto CoBp 2 _1 ^ 6 

Total -..S-i^ir}^ 23 43 



Key: S ■ claas atarta T » testing atarta 0 - Claasroon Observation atarts 

Oltto aarka Indicate off-site coaminltles. 
Observstlon wss December 1. 



38 

39 



K o t 

m 
■ 



m oo o 



o«MOm inoo oo4r« ooo cgoo» oi 



teem e » oo«» ocoo •« o o ooo oo««o » 
« CM CM« » « « mm «n 



»9900 00<^ 900IW ««oo 4)00< 

in (M N. « « « » m « m 



I o o »*» 



M cMoo ocM»«o« «oo me«« oo«» ocMnm ««« « « o oo««« f>^ 

X ^(M^» » <o m m • « « m « cm c« OkCM^ mo^m » « mmm o> 

9* 9t «« «««««« w« ^ 

CM 

M cM^o ocM«40« mo«4 mo«« mo»» oo«o o^-tftln « « o oo««iA m 

>M ^ (M m m • io •« o m « iM •« «» »im»« » « tfttftm o 

! 

I CM90 o m o o mo«4 ooi^m m^o^ ooi*)(> oo««« «(M4) « ^ o oo«««« o 

« »«inin • m •«om«fM «««o »im*« o» « «n «n «n ««s 

! 

E 

CMOO o«»«o« mo»« m o « ^> cm « » oo«o o q» m «m« « « o oo««m m 

o *4CMr^ »4>io m • « ««ttio«CM «««« »cm«« «»fn q» « mtntn o> 

CM 

««CM "CS* Oi K. <0 CM « « O CM»*«« CM«» n<B««« mO»CM «CMCM O « O OlAOKtt O 

u mcMc^. .iAK«»o ^k«o« Oin* ««o»« tf> o *«fn ^mn. « « »« o>cmo>«« » 

M CM CM m — *«fM*4*« ««CM.« — - CM 

».OCM CMO««m «9^CM rM»0« CMin^ ««»m «^«« 9'*«CM CM « « OOK.II.0 K. 

u. mcM» iA««»o CM*«« ^k«*«m oioo ««o*« mocM«*i w* w c « m o>ino>««} « 

M ««M w« « v4 v4 CMCMw«mw«w« ^CMv«v« ^ CM ^ ^ m» «« CM «p 





< »« 


ac o 




K U X 


o « oe 






Mi a o 


u z 


• Ut u 


z 






o < o 




Z X 


O M >• 


(9 


o -> *o 


« ^ o 




MZ 


IK (A< Z 


U. Ul 


« -> • 


z 


a 


a 


^ lA^ Z 




o 


>- Ul »- 


z 


w < 


oe u >> 


(A 


(AZ 




in 


• z 




z 


z 


^ Z 




IM ui 


ZU.M 




o « oe 


e a 






^ oe OX 


Ul a < 


C X • 


a. 






X u o oe 




M ^ ^ 


X Z fi« u 


X 


u « 


-1 « 




(/)(/) 




^ < < X 


Ul 3 




>- 




o .Ai < X a. 




or ^ ^ 


Ui <*4 ^ 




Ul Z Ul 


a z u 


O 




M 0< 


^ O UJ 


Z 2U 


z 






U Z M. <c 




« M M 


Z Z <w 




H- Z 






M O 


< o u s 


M a o 


a 


u 




M 






> 








UJ ^ 




Z u 


(A ■ 


> « a 


»- z z 


> 






IK r tA o o 




^ Ui M 


ox < 




Ul o z 


or ki o < 




> 


a u ► Ul 


z o z z 


«0 o o 


< 




z 


O X 2 O 




s d a 


U » 3 J 


« 


^ 3 U 


a z z 




3 


3 < aI J 


3 « < 3 


z tn^ 


z 


VI 




3 Z 3 « 




M « X 


•« 3 Z 


z 


< » O 


O Ui »i« M 




-1 tn 


^ X -1 


l/t 4/» ^ K 


M Z lA 




< 


t9 


3 u u ac 




< 3 


U, ^ tAK 


a 


u. u u 


^ )r z T 


H- 


Ul «T 


« ^ u ^ 


« UJ lA 


X Ul z 


z 




oe 


z a ^ ^ o 




oe oe o 


1^ 3 UlU 




< »; z 


3 ^ 


1/) 


a. ^ 


)r z u< 


U Z < 3 


(/) ^ z 


u 


Z 




ul S W M u 




o O X 




< 


U < M 


a 3 M Ul 




3 • 


o us Ul 


< C9 z a 


« « o 


a 




> 


3 Ul a a c 




a. 


CO w in 






SKY 


U 


»» u 


U *9 (A 


-> ->« I 


» a. n 








IL Z U 


UJ 

o 
o 


o c o 


o o oo 




o o 


O 


o 




e o c 


o o o 


ooo 


o 


o 


o 


o o o o o 




c o e 


CM CM CM (M 


CM 




IT iT- tr IT 






» » » » 


o e c o 


mm w» 


c\* 


o 




K K K. N. K 




ooo 


^ o d o 




3 3 3 




O 
Z 




3 ^ 


«^ «i« 


^ ^ w* 




CM 




M .M % r« 














< 
« 

Ul 






























•» 




























Ul 












• X 




















« 


















l/S 












Ul 










oe 












z 


















3 






z 






o 




2 




Z 




Z 






s 






Ul 




u 






o 




Ul 




< 


o 




M 










X 


z 




M 


z 


z 






a 










a 




«o 


X 




U 




u 




M 


K 






M 


3 


< 




3 






3 




Ul 




Ul 


e 


o 




U 


>- 


z 




a 






H- 




a 




z 




u 


a. 


oe 


Z 


Ul 



39 



test. Reductions in this number were due to elimination of the children 
from the program for various reasons or to difficulties in the scheduling 
of the children for the tests. Although the Auxiliary Battery was given 
in one session to each child, occasionally the tests were incomplete be- 
cause of difficulties of test administration or the unwillingness of the 
child to complete the test battery. The numbers shown are the maximum 
number of children vAio completed tests that were acceptable for entry 
into the data bank. 
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VI SPRING 1971 TESTING ACTIVITIES 



Planning and Coordination 

In lieu of a general site coordinator meeting that was not included 
in the budget, detailed supplementary instructions were sent to each site. 
These are shown in Appendix G. 

A panel of experts from Michigan State University was charged by 
OCD to visit SRI to review the Planned Variation Evaluation program , its 
data processing procedures, and related issues* This panel was composed 
of Dr. Robert L* Green, Lawrence W* Lezotte, and John H« Schweitzer* 
Their report, which was based on their brief visit on March 15-16, 1971, 
was sent directly to OCD. Because it contained several inaccuracies, 
the executive director of the Urban and Social Systems Division at SRI 
submitted a clarifying letter to OCD on April 1, 1971* This letter is 
shown in Appendix D. 



Tests and Measures Used 
Pupil Tests 

The test battery used in Fall 1970 was repeated in the Spring of 

1971. 

Teacher Ratings 

Ratings of the teachers were obtained by the Head Start directors in 
terms of how well they performed as Head Start teachers. These forms were 
submitted to the Head Start director in February with a request that the 
ratings encompass the teachers* performance in October, their performance 
in February, and a prediction of their perfoxmance in May, 1971. In the 
late spring teacher ratings were again requested of the Head Start 
directors. At this time the request was made that the directors rate 
the teachers on their performance during May with a prediction as to how 
well they would perform the following September* A form similar to this 
and comparable instructions were sent to the Planned Variation sponsors, 
except the instructions in this case were for the sponsors to rate their 
teachers on how well their teachers performed in implementing the model* 
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Class Observations 



Training for the class observers for Level II and Level III sites 
was conducted In the first half of March 1971. New and replacement ob- 
servers received a full five-day training program, and refresher courses 
of one day were scheduled for observers who had worked in the fall of 
1970. Those observers in Level III who had been trained in classroom 
observation were to be retained for the Eight-Block Sort test to be given 
in the spring of 1971. The dates and locations of these training sessions 
were as follows: 



Date 



Place 



Training Type 



March 1-3 
March 3 
March 4-5 
March 8-11 
March 12-13 
March 4 
March 8-11 
March 12-13 



Denver, Col. 
Atlanta , Ga. 
Atlanta , Ga. 
Atlanta , Ga. 
Atlanta, Ga. 
Philadelphia, Pa. 
Philadelphia, Pa. 
Philadelphia, Pa. 



Refresher plus Eight-Block Task 

Refresher 

Eight-Block Task 

Full course 

Eight-Block Task 

Refresher 

Full course 

Eight-Block Task 



Eight-Block Sort, Mother/child Interaction Test 
(Level III Only) 



The Eight-Block Sort test was not administered in the fall of 1970 
but was included in the Spring testing according to the test plan. Only 
the mothers of the children who did not take the Binet could participate 
in the Eight-Block Sort Task. The scheduling of the mothers was to be 
arranged by the site coordinators, which avoided any involvement on the 
part of the Head Start director or her staff. To maintain a reasonable 
schedule of testing it was necessary for the Eight-Block testing to be- 
gin at times before the pupil testing. As indicated above, the class 
observers were used for the Eight-Block Sort to capitalize on the type 
of training they had received for the Classroom Observation instrument. 
These classroom observers received full training in the administration 
and scoring of the Eight-Block Sort test and were prepared to instruct 
an Eight-Block trainer at the^home site so that the Eight-Block trainer 
could teach the mother the task to be done. This procedure was chosen 
because the observer was highly trained to record interactions and she 
could most effectively score the testing. In addition, it was possible 
to reduce the travel cost of the Eight-Block training sessions. 



Parent Information Form (Level III Only) 



When the mother appeared for the £ight*Block Sort Task, she was 
presented with a Parent Information Form (PIF) that was to be completed 
before she left* A Spanish version of the form was prepared and avail- 
able for those mothers who could speak Spanish only* 

The Parent Information Form was submitted to OCD for review and 
comment* The final version was sent to the Head Start directors for 
comment following consultation with their PAC Chairmen on the format 
and content. The Head Start directors were encouraged to identify any 
portion of the PIF that they or the PAC felt was inappropriate so that 
alterations could be made. Although the PIF had been submitted to some 
field trials at Menlo Park before submission to the Head Start directors , 
it still was felt necessary to request their comments and to be responsive 
to the particular needs of the various communities. This version of the 
PIF had been greatly reduced in size over that of the first year to ensure 
that parents would complete it. It required only from 20 to 40 minutes 
to complete, depending on the reading speed of the mother. In the event 
that the mother was unable to read English, the tester (who was called 
the parent interviewer for administrative convenience) was instructed to 
solicit very gently the information that the mother could not cope with 
the English language and to offer her assistance in reading the items* 
A degree of awkwardness occurred at this point since the instruction to 
the parent interviewer was to present the infonnation form to the parent 
for completion and to have the parent'insert her completed forms in an 
envelope after she had reviewed her answers to be sure that she had 
answered every question, to seal it* The use of the sealed envelope 
was to assure the parent of the confidentiality of her answers* If the 
parent was unable to read, the interviewers were instructed to make a 
verbal presentation of the items* The tester who presented the PIF to 
the parent had been admonished to protect carefully the feelings of those 
parents who were unable to read* 

In view of the extra time that the mothers must spend in completing 
the PIF and the expenses incurred for baby-sitting or taking time from 
their Jobs, an honorarium of $3*00 was provided for each mother who com- 
pleted the information form* The money was given in cash when the task 
was completed to avoid the delay of payment by check. 



Teacher and Aide Information Form (Levels I, II, and III) 

A revision in the Spring 1970 Teacher Questionnaire was submitted 
to OCD for review and approval, along with the shortened, modified 
version to be given to the teachers' aides* This Teacher and/or Aide 
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Information Form was also made available in a Spanish version for the 
convenience of those who preferred to read the questions in Spanish 
rather than in English. It is interesting to note that only four aides 
availed themselves of this opportunity to take this Spanish version of the 
Aide Questionnaire Information Form (and only two used the Spanish PIF). 
The Teacher and Aide Information Forms were sent to the Head Start di- 
rectors for review (with their PAC chairman) to identify the questions 
that they felt were inappropriate to their own communities. A request 
was made for them to send their criticisms to SRI so that questions could 
be eliminated or altered to satisfy the requirements of the various com- 
munities. Although the revised information forms for teachers and teachers 
aides had been given to Head Start teachers in the Menlo Park area for 
criticisms and several changes had been incorporated, there was still a 
need to submit the questions to the particular communities in the PV 
evaluation to eliminate items that imposed on the privacy of the teachers 
and ai'des. The Teacher and Aide Questionnaires were distributed by the 
SRI site coordinators during the testing period, along with the necessary 
supplementary instructions and stamped envelopes to be used for direct 
mailing back to SRI of the completed questionnaires. In this way it was 
possible to maintain the privacy of the teacher and aide responses. 



Ethnic Heritage Tests (Levels II and III) 

The children's cultural awareness scale and the ethnic identity 
questionnaire that had been administered in fall 1970 were again offered 
to the communities for use during the Spring testing. Those communities 
where the Head Start director gave permission had one or both of these 
tests administered. As with the preparations for the fall presentation 
of these instruments, the Head Start directors were again requested to 
confer with their PAC chairman to decide if one or both tests should be 
given to the children. Approximately half the communities agreed to the 
presentation of the ethnic heritage tests. 

Classroom Information Form (GIF) 

Communities were provided with computer printouts of copies of the 
GIF data from Fall 1970 tests, with instructions to complete indicated 
missing information and to add certain data not available in the fall, 
i.e., the transfer date of students, admission date of new children, and 
number of days absent. 
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California Preschool Social Competency Scale (CPSC) 



The CPSC was completed by all teachers who had filled in the ratings 
in the fall of 1970. A stipend was given to the teachers for their efforts. 



Test Sample 



The communities tested in the fall of 1970 were unchanged except for 
the withdrawal of Acoma from the PV evaluation program. 

Withdrawal by the Acoma Comparison Site 

During March 1971 there were indications that the Acoma, New Mexico, 
Head Start Center was contemplating withdrawal from participation in the 
Head Start Planned Variation Evaluation activities. A meeting was held 
with the community members, including the CAP director, on April 21, 1971, 
to explore the possibility of continuing using Acoma as a comparison site 
for Oraibi in the PV evaluation. At the request of the Head Start director, 
the community members at this general meeting voted for the testing in 
Acoma to be terminated. 

The basic issue seemed to be that the members of the Acoma community 
were quite opposed to being considererd a "comparison" for Oraibi, which 
was a Hopi reservation. In addition to the reluctance of the Acoma com- 
munity to be compared with the Hopi, was the fact that there would be no 
follow-up of their children who completed the Head Start program in any 
subsequent Follow Through testing since Acoma was not a non-Follow Through 
testing site. Here is a case where the term "comparison" worked to dis- 
advantage. The term "comparison" had been carefully selected to avoid 
the connotions of control groups, since, as was pointed out in the In- 
terim Report, the groups against which the PV classes were to be compared 
were not controls but in fact were reference or comparison groups. Had 
the Acoma site been identified as a "control" , group, there is a possibility 
that they would have remained as a comparison site. However, the Head 
Start director (who was very new in her task) was strongly opposed to any 
testing of the children. Shortly after the decision of the Acoma com- 
munity to withdraw from the Head Start activity, the Head Start director 
resigned from her position. 

At the conclusion of the community meeting, which was well attended 
by parents, the CAP director, and the Indian governor, interest was ex- 
pressed in continuing the testing the following fall (1971) if some 
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arrangements could be made for follow-up testing of the children as they 
went into kindergarten and the first grade* Since Acoma was never sched- 
uled to be part of the Follow Through evaluation no further testing 
occurred at this site. 



Implementation of the Spring 1971 Testing 

The spring testi^pf^ was accomplished according to the schedule in 
Table 12 , which shows the periods of classroom observations, the inter- 
vening Easter vacations , and the beginning and end of each test period. 
Also included on this table is the identification of those communities 
that opted to include either or both of the ethnic heritage tests. 

Since the details of implementation for Spring 1971 are given in 
detail in the instructions to site coordinators of Levels I, II, and III 
in Appendix D| they are not repeated here. 



Tests Administered 

The tests administered in each community are shown in Table 13. 
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VII FALL 1971 TESTING ACTIVITIES 



For the 1971-72 Planned Variation evaluation activities, the role 
of SRI changed from that of being responsible for the evaluation to one 
of providing field data collection activities for OCD. The specifications 
of the test battery, the sample site, and the analysis of all the PV data 
became the responsibility of the Huron Institute, Cambridge, Massachusetts. 
During the 1971-72 testing period there was complete coordination among 
SRI, Huron, and OCD to ensure that all the testing activities were con- 
ducted in the best possible way. 

Planning and Coordination 

A two-day coordination session for Head Start directors from the 
Level III sites was held in Menlo Park at the end of July. During this 
time all the tests and policies were reviewed in great detail, including 
the specification of the role of the site coordinator for her implementa- 
tion of the testing. This coordination session was a very fruitfull one 
in that it provided Head Start directors with a clear understanding of 
all the details of the evaluation activities that would occur during the 
year. They also' had the opportunity .to input their suggestions for the 
planning for the 1971-72 field work. Representatives from Huron and OCD 
also participated in the meeting. 

This coordination meeting with the Head Start directors was the most 
critical and important event that occurred during the year. As a result 
of this session, community problems became negligible and the cooperation 
that occurred with each of the communities was superb. 

Tests and Measures Used 

According to the plans of OCD and Huron, each child in the tested 
sites was administered a basic battery consisting of the Peabody Picture 
Vocabulary Test, the Wide Range Achievement Test (WRAT) (letters and 
numbers only) , and the Pre-School Inventory Test (Hertzig-Birch scoring) . 
Given separately for administrative reasons but still part of the basic 
battery was the Brown IDS Self -Concept Referents test. A supplementary 
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battery consisting of the ETS Enumeration, the Illinois Test of Psycho- 
linguistic Abilities (ITPA) subtest on vocal encoding, and the Motor 
Inhibition Test was administered to a third of the children in each of 
the tested classes , or a minimum of six children per class. 

The Eight-Block test was admininistered to those children who had 
received the supplementary battery. The mothers who participated in the 
Eight-Block Task also completed the Parent Information Form. 

The communities in which these tests were administered are referred 
to as Level III sites. Level I sites consisted of the remaining Planned 
Variation sites that did not receive any pupil testing. The Level I and 
Level III sites also were administered the Classroom Information Form 
and the Schaefer Ratings of children by the teachers. These ratings were 
done by the teacher during the seventh week of class to give her a suf- 
ficient period of time to become familiar with her children. The ratings 
of the teacher's performance by the Head Start directors and by the spon- 
sors using forms similar to those used in 1970-71 were completed during 
the fall. A Teacher Information Form was administered to all Level I and 
Level III teachers during the test period. 

Test Sample 

PV and Comparison Sites 

The communities to be tested were specified by OCD and Huron. Within 
the Level III sites where pupil testing was to occur, a set of guidelines 
for identification of the particular classes to be tested was established 
by OCD and Huron. Essentially, previously tested teachers were to be 
retained in the sample. Testing was to be accomplished in up to but not 
exceeding four PV and/or four comparison classes per site. If more than 
four classes were available, teachers new in the sponsor's program were 
to be eliminated. In the event that there was no such basis for the 
elimination of classes, then the choices were made on the basis of random 
selection. In the case of comparison classes, one overriding considera- 
tion was the predicted likelihood that the children in the comparison 
class would wind up in a kindergarten or a first-grade class that would 
be in the Follow Through test sample (as could be best predicted a year 
before the fact). Close coordination was made with each Head Start direc- 
tor for identification of the comparison classes to be tested and with 
each sponsor for identification of the PV classes to be tested. 



Providence was dropped as a comparison site due to testing diffi- 
culties* Additional comparison classes in Caruthersville were added 
for the fall and spring testing. 

Control Sites v 

One of the plans laid out early in the Planned Variation program 
was to incorporate a set of "control" children in the third-year evalua- 
tion activities. This control group, as distinct from the comparison 
classes, would be composed of children who were eligible for Head Start 
but did not receive any of the services and were not participating in 
any similar programs supported under Title I, Model Cities, Day Care, 
or any other subsidized program. As is seen below, it is not always easy 
to find poverty level children who do not participate in some way in lo- 
cally or federally funded support programs. 

Selection of the Control Sample — The criteria specified by Huron 
for selecting the control group samples were to match the characteristics 
of the controls with that of the PV group in terms of region (north and 
south), place (urban and rural), and ethnicity (black, white and Mexican 
Americans). Thus the samples in the control group should represent 
northern blacks, northern whites, southern rural blacks, and Mexican 
Americans. 



Selection of Control Sites — To satisfy the conditions stated above, 
Huntsville, Alabama, and the San Francisco Bay area were designated by 
OCD as the two areas in which to collect the control group data. 
Huntsville also had the advantage of an SRI field office that could be 
used for logistical support as needed. Samples drawn from Huntsville 
would represent southern urban whites, southern urban blacka , southern 
rural whites, and southern rural blacks. Samples drawn from the 
San Francisco Bay Area would represent northern blacks, northern whites, 
and Mexican Americans. 



C ontrol Sample Recruitment — Recruitment in Huntsville proceeded well 
in the rural area. With the assistance of Mr. Thomas Botello, director 
of No. 7. Neighborhood Center, a sufficient group of children was avail- 
able for testing. In the urban area Mrs. Marjorie Smith, SRI site 
coordinator in Huntsville, obtained a smaller group through the City 
Demonstration Agency with the assistance of Mrs. Mary Nell Lawlor. 
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Recruitment in San Francisco Bay Area was quite difficult. At first 
it seemed that the Head Start Regional Office would be the most logical 
resouxce to obtain the control children. They might have children on 
their waiting list although there was the risk of losing them into the 
Head Start program during the test-retest interval. The Regional Director 
suggested San Jose as a possible source of control children. 

In San Jose they did have a waiting list for each of the Head Start 
centers; in addition, 80 to 85% of their Head Start children were Mexican 
Americans. However, the director felt their names could not be released 
because of legal restrictions. When the restrictions were removed through 
clearance with Dr. J« Klein, OCD, Washington, complete cooperation was . 



Doubts and uneasiness were expressed by some of the Head Start staff 
in the San Francisco Regional Office. Two meetings were held with them 
to explain the objectives and procedures of this data collection and to 
answer their questions. They were concerned that data from this control 
group might affect negatively their Head Start fundings in the future. 
Even though they finally produced a waiting list, follow-up spot checking 
indicated that the group of children available was too small to Justify 
pursuing. Other sources SRI inquired into without any definite results 
included the San Francisco Unified School District, another preschool 
program, and the Surplus Food Program. 

Meanwhile, the search was extended to adjacent communities including 
East Palo Alto, San Mateo, the San Mateo County office, Hayward, and Oak- 
land. When the Head Start director in any of the communities contacted 
was responsive, a meeting was arranged. Unfortunately, the outcome of 
these meetings was the same: there were either too few children available 
or none at all. The main reason for this scarcity seemed to be that pre- 
school programs other than Head Start were available in the community. 
Parents who vi?ro interested in sending their children to preschools did 
not have to so long as in the previous years. 

The next alternative was to search beyond the San Francisco Bay Area. 
Exploratory inquiries were made to Martinez and Sacramento. Martinez had 
a large enough group of children available, but they were reluctant to 
participate because of their concern about community reactions. Finally, 
the Sacramento Unified School District gave their full support and com- 
plete cooperation in obtaining control group children. Mrs. Elvie Watts, 
director of Parent-Preschool Education in the district, assisted in iden- 
tifying the children and in recruiting the personnel. It should be noted 
that the sample consisted of children on, their Head Start waiting list. 
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siblings of children participating in the school free lunch program (it 
has eligibility requirements similar to those of Head Start) and children 
referred by community people. 

Parental Contact for Control Testing — ^As soon as the necessary 
information such as name, address, and phone number of each child was 
available, persons from the community were recruited for contacting 
the families. Each parent who consented to participate in the testing 
with her child was requested to sign a permission slip. 

Control Testing Facilities — Since the control children were not in 
school, testing was held in a neighborhood church. A rental fee was 
agreed on. 



Test Battery for the Control Group — The Basic Battery (PPVT, WRAT, 
PSI, Brown Self -Concept) was administered to all the control group 
children. Parents were administered the Eight-Block Sort Task and 
Parent Information Form. Testing was done in one sitting, and each 
parent was paid $5.00 for her participation. 



Control Group Data Collection — All parents were contacted again 
for Spring testing. The criteria for retest were: the child had to 
come with the same adult as in the fall, and the child was not in any 
preschool program at the time of retesting. 



Control Group Tests Administered — The tests given in the fall 
were readministered to all the control children in the spring, with 
the following exceptions as specified by Huron: 

(1) The Brown Self -Concept Test was administered to 25 children 
in the spring in both Huntsville and Sacramento. To allow 
for attrition, 35 children were randomly selected, and the 
tester was instructed to stop giving the Brown test as 
soon as the 25th child had been tested. To eliminate 
feelings of differentiation (children to be tested were 
waiting in the same room) and to equalize testing condi- 
tions as much as possible the non-Brown test children. 




including the ones in San Jose, also had their pictures 
taken. 



(2) On the WRAT, the following subtests were administered: 

Copy Marks, Name Spelling, Recognizing and Naming Letters, 
Dot Counting, and Reading Numbers. 

The number of control children tested is shown in Table 14 . 



Table 14 

NUMBER OF CONTROL CHILDREN TESTED IN 1971-72 



Site 


Type 


Fall 1971 


Spring 


Huntsville 


Rural 


67 


46 




Urban 


27 


18 


Sacramento 


Urban 


101 


61 


San Jose 


Urban 


39 


22 


Total 




234 


147 



Implementation of the Fall 1971 Testing 

Selection and Training of the Field Organization 



Site coordinators were selected in coordination with the Head Start 
directors in the Level III testing sites. A high priority was placed on 
obtaining a person from the community who had experience in testing, could 
coordinate the diverse aspects of the evaluation program, and could inter- 
face with the many community members that would be involved* A college 
degree and previous work with young children was particularly desirable, 
as were formal credentials in testing* Considerable weight was placed 
on the recommendations of the Head Start directors who were particularly 
attuned to the nature and problems of the connnunity. Site coordinators 
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were not used on Level I sites; instead, a modest stipend was provided 
to the local sponsoring agency to compensate for the additional effort 
made by the Head Start director and her staff to get the Class Informa- 
tion Forms, Teacher Information Forms, and the Schaefer ratings completed. 
Details of these arrangements can be seen in the field communication of 
August 20, 1971 in Appendix E. 

The site coordinators were responsible for recruiting the testing 
staff among the community members if at all possible. Each coordinator 
had an aide to assist in various clerical tasks and in the scheduling 
and transportation of mothers for the Eight-Block Sort Task. The Basic 
Test Battery testers. Supplementary Test Battery testers, and the Brown 
testers were to have a minimum of a high school education but preferably 
some college experience. In the case of Eight-Block observers (who were 
scheduled to be the classroom observers in the Spring 1972 tests) college 
experience was deemed most desirable. The Eight-Block trainer was required 
to have a minimum of a high school education. In each instance, however, 
considerable weight was given to the fact that the applicants were capa- 
ble of dealing with children four to five years old, were familiar with 
the patois of the neighborhood, and were predicted to be capable of learn- 
ing thoroughly the tests and procedures. 

During the first year of the evaluation (1969-70), the presence of 
exceptionally well qualified testers who were not members of the community 
in which the tests were administered resulted in some frictions and dis- 
satisfactions among the local people. At the behest of some Head Start 
directors, an effort was made to see if minimally qualified local people 
could, in fact, be trained sufficiently well to administer the tests in 
the Head Start PV battery. Using the class observation procedures as a 
test bed, it was demonstrated that minimally qualified local people (grade- 
school graduates) could be brought up to criteria. With this encourage- 
ment, future recruiting for testers was oriented toward neighborhood 
people. 

The application for each of the test personnel was submitted to SRI 
for final approval, having first been cleared with the Head Start director. 
< If the site coordinator, in conjunction with the Head Start director, 
predicted that an applicant could accomplish the testing tasks, that 
applicant was accepted unless she had previously performed poorly for SRI. 

Three days following the Head Start directors* meeting, a five-day 
training and coordination session was held at SRI for all 30 site coor- 
dinators (August 2-6). During this period they received complete orienta- 
tion on Planned Variation and the evaluation activities. The core of 
this five-day session consisted of periods of detailed instruction on the 



testing procedures, methods, and means for training testers on site, with 
emphasis on those characteristics that were acceptable and nonacceptable 
in the tester's relation to the children. In one sense, the training 
session often became fairly pedestrian inasmuch as the words that were 
being used were those that were expected to be applied in the local train- 
ing of the testers, including role playing, the simulation of chii<:?sh 
mistakes, and the use of a vocabulary that would be most meaningful and 
communicative to the testers in the communities. A summary statement of 
training principles was subsequently issued to each site coordinator (see 
memo, August 23, 1971 in Appendix E). 

Two portions of the training of the site coordinators were necessarily 
abi*idged: the training in the class observation procedures and in the 
Eight-Block Task observation procedures. This restriction was necessary 
in view of the time it would take to bring the site coordinators up to 
proficiency in the Classroom Observation procedure (to be administered 
in early spring) and the Eight-Block Sort Task. The intention was to 
give them sufficient information so that they could give at least a cur- 
sory checkout of the data forms submitted to them by the Classroom Obser- 
vation and Eight-Block observers. The details concerning selected testing 
matters are described in the field communication dated August 23, 1971, 
in Appendix E. 



Eight-Block Observers 

The Eight-Block observer was to serve also as the classroom observer 
for observations to be done in the early spring. Two three-day training 
sessions were held at SRI followed by a third session in Baltimore for 
the Eight-Block observers who were in turn expected to train the Eight- 
Block trainers back in the home communities. 



Testers 

Basic Battery, Supplementary Battery, and Brown testers were trained 
by the site coordinators in their home communities before the beginning 
of testing. The site coordinators were instructed to have all testers 
role play and practice tests with children who were not in the classes 
to be tested. The site coordinator typically spent five days for the 
training and preparation of the testers, distributing the training ses- 
sions over the week, but the total time the tester actually worked in 
preparation for her task was limited to 16 hours with pay. 
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Field Supervision by the Project Staff 



Procedure — Twelve members of the project staff who had detailed 
familiarity with the testing procedures assumed the role of field super- 
visor and visited the 30 Level III test sites. Initial phone contacts 
were made to check on the status of staffing, arrival of materials, ten- 
tative plans, and the like. 

Field supervisors arrived at least one day before testing started 
to review with the site coordinators all the procedures to be followed, 
to check out each tester in a pseudo-testing situation, and to examine 
personally each of the available testing facilities. 

In addition, the SRI field supervisor was to observe each tester as 
she began her testing, even if it meant delaying the testing in some cen- 
ters for the SRI staff member to be present for the initial testing. A 
third day was used to continue the checkout procedures. During the three- 
day visit it was the responsibility of the SRI field supervisor to respond 
to any questions and requests of the site coordinator and the Head Start 
director. Often this included a formal explanation of the evaluation 
activities to the teachers and selected PAC members. 

The practical purpose of these visits was to engage in "public re- 
lations,** to resolve local problems, and to be sincerely responsive to 
the demands of the community so that the testing could be implemented 
with as little disruption as possible. It was the responsibility of the 
SRI field supervisor at this time to make a final Judgment on the perfor- 
mance level of the testers. On two occasions testers were released from 
their duties (after consultation with site coordinators) and replaced. 
In other circumstances testing facilities were rearranged so that the 
testing could be accomplished under better conditions. 

Table 15 shows the periods during which members of the project visited 
the 30 testing sites and also indicates the first day of class. Whenever 
possible, testing began during the second week of class (after the children 
had been in class five or six days). In some locations, however, it was 
necessary to delay testing until enrollment was completed or funds had 
been received by the community from Head Start. 

Site Reports were completed by each supervisor^ The form is shown 
in Appendix J. 

Fo 1 low-up -'-^Each site coordinator was instructed to keep in close 
telephone contact with SRI after the field supervisor's visit if any 
problems should arise regarding procedures, personnel, community problems 



1 

u u 
0) o 
Oi m 

OS 9 •H 
CO CO > 



U 00 
0) ^ 

JO 

o 
4^ 

S3 



i 

s 

B 

H 

5 

CO 

§ 

M 
(0 
M 
> 



o 



u 
o o 

jO n 
B 
0) 
•p 
a CO 

(0 




r 



M O 

n 

5 ■ 



^1 



E 



n 



9 



O 

s 
s 
s 



u 



B 



^ n « 

0) d M 

>» ^ M 

« u o 

0) ^ a 
^ o 

U >% G 

B d 9 

^ O 

H 

0) a h 

•p h « 

^ o 

S ^ ^ 

CO II II 



bO 
B 



m 

0) 



o 
& 

d 

•a 

0) 
B 
O 

•a 
> 

.d 













B 










0 




oa 






Gore 


EDC 


Pltl 


REC 





B 
B 

O O 

a > 

•P 

M B 

* * 



^ • 58 



affecting the testing, and the like. On return of the project staff to 
Menlo Park or during subsequent field visits, if necessary, follow-up 
phone calls were made with sites visited to check on the problems that 
had arisen. Each site coordinator and travelling SRI project person had 
been encouraged to call SRI about any incipient problem and particularly 
to call before making any decisions about changes in testing procedures. 
Such a procedure helps avoid arbitrary decisions being made in the field 
without being coordinated with OCD and all other test sites. 



Visits to Sites by Non-SRI Personnel 

From the very beginning, SRI encouraged both OCD and Huron to make 
site visits to inform themselves about the processes that occur in the 
classrooms and also to become intimately involved and knowledgable in 
the details of testing. Such an invitation is not without its vicissi- 
tudes: one of which is extending the openess of the testing to careful 
scrutiny. Although such examinations can often be embarassing, the end 
product of such examinations should certainly be an improvement in the 
quality of the evaluation of Planned Variation for OCD. 



Huron Observers 

When Huron Institute inquired about the schedules of testing for 
their own visits, SRI specifically requested that Huron personnel not 
appear luring the days that SRI was making its final coordination and 
checkup '>t its field staff because the presence of extra personnel could 
be disquieting at the very least and could place undue pressures on the 
testing personnel. SRI also requested that one or at the most two people 
appear at any one site; that the Head Start director be contacted formally 
before the visit; and that, if possible, the SRI site coordinator be in- 
formed of the impending visit to enable her to schedule her day so that 
she could be useful to the visiting people. It was also specified that 
the visitors keep a low silhouette, avoid interfering with any testing, 
and, if necessary, only listen in from the outside of a testing room if 
it appeared that the presence of an extra person would be disruptive to 
the testing procedure. This guidance was not in conflict to the counsel 
given to the SRI personnel, who were enjoined to listen in as surrepti- 
tiously as possible even if it meant not seeing the tester and child 
actually in the test situation. In most cases the presence of an extra 
observer does not unduly distract a child if the visitor maintains a 
low silhouette. SRI specifically requested that any observation of a 
failure to maintain a proper testing environment or to follow a prescribed 
testing procedure be communicated directly and immediately to the project 
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and that in no circumstances should any comments be made to testing per- 
sonnel in the field. This is not only courtesy but good management, 
because the testing personnel were under direct control of SRI and were 
answerable only to SRI. 



OCD Monitoring of the Testing Procedures 

It was expected that OCD would carefully monitor the testing in the 
various sites to satisfy itself that SRI had indeed complied with its 
contractual obligations. It is unfortunate that the observers sent to 
various sites by OCD were not instructed to contact SRI immediately on 
identification of any suspected discrepancies in testing procedures. 
Reports filed after the testing had been completed were of no value ex- 
cept for planning for the Spring sessions. It would have been more useful 
had these observers been instructed to contact SRI immediately so that 
corrective action could have taken place where it was appropriate. 

Without having participated in the training sessions that were run 
for the site coordinators in Menlo Park, it was unlikely that any outside 
observer would be sufficiently familiar with the specified conditions of 
the testing to be able to make objective on-site comments. For example, 
comments by the OCD observers indicated that the procedures being used 
in the testing (which were consistent with the ground rules established 
in Follow Through starting in 1968) were not fully appreciated by the 
observers, i.e., explicit instructions were given for all testers to read 
instructions rather than to commit them to memory (with the concomitant 
daily variations that could eventually change the instructions over a 
period of two or three weeks). Also, the use of the Tester's Log was 
not fully appreciated. Each variation in test administration was to be 
entered in the Tester's Log, To expect each tester to administer per- 
fectly every test for every child is unreasonable, and the testing pro- 
cedure required that any aberration in administration was to be entered 
in the test log. 



Reliability Studies 

The data collection for a set of reliability studies was carried 
out as specified by liuron Institute. These efforts focused on the Eight- 
Block Sort Task, selected tests of the pupil batteries (PSI, Motor Inhi- 
bition, ITPA, and Enumeration), the Schaefer ratings of students by 
teachers and selected aides, a comparison of selected information that 
appeared on the Parent Information Form and the Classroom Information 
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Fornii and, finallyi a study of the reliability of the data coding activi- 
ties conducted at SRI. The details of the design specifications and the 
outcome of these substudies are contained in the Huron reports. 



Tests Administered 

The number of tests administered in the various communities is shown 
in Table 16. 
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VIII SPRING 1972 TESTING ACTIVITIES 



Planning and Coordination 

A reduction in the number of sites for class observations was made 
in view of budgetary restrictions imposed by OCD. As a result, the 
Classroom Observations and the Eight-Block Sort Task were administered 
only in Portageville, Duluth , Lock Haven, Elmira, Fort Walton Beach, 
Tupelo, Wilmington, and Paterson. Because of the loss in shipment of 
a trunk of data from Chattanooga after the Fall testing, the Eight-Block 
Sort Task was added to sites in Jonesboro and Houston, which follow the 
Gordon Parent Educator model. The Brown test was also restricted only 
to those sites where class observations had been made. 

As a result of SRI meetings with the OCD advisory panel, an enlarged 
field supervisory effort was supported for the Spring testing activities, 
as described below. 



Tests and Measures Used 

The Spring test battery was enlarged according to the plans of OCD 
and Huron. Basic Battery A consisted of the WRAT (enlarged to include 
all eight subtests), and Gumpgookies. A shortened version of the Gump- 
gookies was used as described in the March 18, 1972, memo in Appendix F. 
Basic Battery B consisted of the PPVT, the PSI, and Enumeration. These 
batteries were given to all children in the tested clasjses. A Supple- 
mentary Battery consisting of Relevant Redundant Cues (Zings and Poggles) , 
Motor Inhibition, and ITPA subtest on vocal encoding was administered to 
one third of the children in each of the tested classes. Based on the 
tests that had been presented to children in the fall, specifications 
were made for each child in the Fall testing on v^ich tests were to be 
readministered in the spring. The shift of some tests in the test battery- 
for example, Gumpgookies had been added to the Basic Battery and Enumer- 
ation had been shifted from the Supplementary Battery to the Basic 
Battery—necessitated a careful specification of which tests or test 
batteries were to be assigned to each child. Approximately 17 combi- 
nations of child/test arrangements were available. Computer printouts 
specifying exactly which test batteries were to be given to each child 
were provided to each site coordinator and tester. 
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Certain items on the Class Information Form had to be updated, for 
example, the number of days the child was absent, the date any child left 
the class, and the identification of children who had enrolled after the 
Fall testing. 

The Schaefer Behavior Inventory and the Teacher Information Form 
were to be completed by the teachers. The Eight-Block Sort Task and 
Parent Information Form were given only in those communities identified 
above. 

Ratings of the teacher's performance by the Head Start directors and 
the sponsors were made during the test period. 

A Director's Evaluation of the Model and Implementation Report was 
sent to each Head Start director, and her comments on the model and im- 
plementation were solicited. This form was prepared by Huron. 

After the last day of testing had been determined, specific test 
dates were assigned to each community so that the testing could be accom- 
plished in the fourth, third, and second week from the close of the center 
unless the center was open all summer. In no event were tests scheduled 
to be given after the first week of June (except in the control sites 
where the testing was extended to the middle of June to compensate for 
their later testing period in the fall.) Actual dates of training, 
supervision, and testing in each of the sites are shown in Table 17. 



Implementation of the Spring 1972 Testing 
Training of the Field Organization 

The classroom observers were trained at SRI in joint sessions with 
Follow Through classroom observers during January 12 to 19 and January 26 
to February 2 in preparation for the observations scheduled during 
February and March in the eight Level III sites. Each observer was 
again checked on site by an SRI classroom observer trainer. 

Two site coordinator training meetings were conducted at SRI from 
March 20 to 24 and April 10 to 14, 1972. Holding two meetings permitted 
individual attention to be given to smaller groups. With the smaller 
groups it was possible to provide young children as practice test sub- 
jects for the site coordinators. 

One particularly useful activity that was incorporated in this site 
coordinator training session was the use of especially prepared quizzes 
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with detailed answers that were used for training and assessment of the 
level of knowledge the site coordinators had on the tests and their pro- 
cedures. These quizzes were oriented to the topics, items, and procedures 
that had been particularly troublesome in the field. The main purpose of 
these test quizzes was to provide the site coordinator with an additional 
learning activity during training. The quizzes could also be used in the 
home cojranunity when she trained her testers. The tests established a 
minimum criterion in assessing the testers proficiency level. SRI field 
supervisors could also use the tests as an objective means to assess the 
level of competency of site testers if a question arose as to whether a 
tester should be replaced. From reports of the site coordinators and 
field supervisors it was apparent that these especially developed tests 
were extremely useful in the training of the field staff. Copies of the 
quizzes and answers comprise Appendix I. 

Training for the Eight-Block observers was conducted during the week 
of April 17 at SRI. 

Tester training in the communities by the site coordinator was 
planned for one week's duration, and the tester was paid for up to 16 
hours of active work. During this period each tester was to practice 
testing young children who were not in the test sample. 

Field Supervision by the Project Team 

Very extensive supervision was effected during the spring testing. 
In each test site an SRI field supervisor spent five days, two or three 
of which occurred before the beginning of testing so there was the time 
and the opportunity to check out each testing facility and each tester. 
If the training was substandard, a supervisor was empowered to delay 
the testing of any and all classes and/or testers. The field supervisor 
remained on site for two or three days of actual testing to make sure 
that the procedures were being followed as specified, and then completed 
the site reports (see Appendix G) . 



OCD Monitoring of the Testing 

The Fall 1971 experience highlighted the need for immediate feed- 
back from the OCD monitors for effective action. Also, it was obvious 
that the OCD monitor had to know thoroughly all the current procedures 
to be able to identify any anomalies in the testing procedures. SRI 
suggested to OCD that the monitors be required to pass the test quizzes 
discussed above as a minimum preparation for their tasks. OCD immed- 
iately concurred in this requir^ent, but in fact the procedure followed 
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was to provide each monitor with the quizzes and related material for 
self-study. There was no need for the formal assessment: OCD had In 
essence agreed In principle on the procedure and, since the monitors 
were all eminently qualified as test and measurement experts, a review 
of the available material was all that was needed. 

The monitor's communications from the field were both timely and 
helpful « The procedure that OCD initiated and supported Is one that 
should be used more frequently In the monitoring of similar data col- 
lection efforts . 



Tests Administered In Spring 1972 

The number of tests administered In each community is shown In 
Table 18. 
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FALL 1969 COMMUNICATIONS 




Appendix A 

FALL 1969 COMMUNICATIONS 
CONTENTS 



Date To Subject 

*14 Aug 69 HSD Letter re HSPV Evaluation Plans. A-5 

*21 Aug 69 HSD (GIF, Test Coord., 8 Bl . Mothers) A-12 

25 Aug 69 HSD Planning Factors for Sponsor Video 

Taping of Teaching Situations 

*27 Aug 69 HSD Updating HS Class Information A-14 

29 Sep 69 HS Sponsors Teh. Ques. and Review 
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STANFORD RESEARCH INSTITUTE 



MENLO PARK, CALIFORNIA 9402^ 

August 14 I 1969 



The attached document is a brief statement summarizing the 
nature and extent of the evaluation of planned variations in 
Head Start programs that Stanford Research Institute will conduct 
during the coming year. It identifies the objectives and goals 
of this evaluation and some details of the plan of implementation* 
It is hoped that this brief document can provide a basis for 
mutual understanding between Stanford Research Institute and the 
sixteen communities that are involved in the planned variations 
for Head Start, describe the extent of the evaluation effort that 
SRI will engage in and indicate briefly some of the local arrange- 
ments that will be required. Two copies of the plan are attached 
for your convenience so that you can offer one of them to the 
parent group for their study and evaluation. 

Biembers of our staff have been in contact with you by telephone 
and one of the later items of business has been the matter of ar- 
ranging the attendance of yourself and appropriate members of the 
Head Start parent community at the training sessions that will be 
conducted during September in various cities around the country. 
At these training sessions SRI will convey the details of the 
procedures and techniques of evaluation that are to be applied in 
each of the Head Start communities. We feel that it is most im- 
portant that each director and at least one of the community 
members (preferably a person (s) who can represent the parent greups), 
be in attendance in order to learn firsthand the working details of 
the evaluation plan and to meet the personnel who will be involved. 
The initial September training sessions will include those commun- 
ities whose Head Start centers are starting before mid -September. 
The other communities whose starting dates extend into October will 
be treated separately and further details will be sent to those 
communities subsequently. Included with this letter is the schedule 
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of the locations and times for the various training sessions and the 
SRI personnel who will conduct them. As indicated to many of you 
through recent phone calls i the travel arrangements will be made by 
the Head Start office in Washington and you can expect shortly to 
receive instructions as to the administrative details of your 
ticketing and per diem to the training sites* 

At the training sessions you will receive detailed information 
as to how the evaluations will be conducted and the plans for in- 
corporating local community interests and expectations in the Head 
Start evaluation. The test plans were developed in Joint session 
with the eight sponsors of the planned variation programs for Head 
Start. 

The plan, with the concurrence of Head Start, Washington, is 
to initiate the community Head Start evaluations on the first Monday 
following the beginning of the Head Start centers in each community. 
At this time a team of between two to six testers (depending on the 
number of classes and pupils involved) will appear and make all the 
final preparations for the testing procedures which should begin 
the following day and be concluded in two weeks. It will be necess- 
ary to obtain two aides to assist in the testing for each class that 
is to be tested. These aides are to be local community people and 
will function initially as our interface with the children (for^ 
indeed, the SRI tester is a "stranger in town" and it behooves us 
to make provision to establish the best possible rapport with the 
children). The aides will be paid by SRI according to the hourly 
rates in effect in the community. 

The present testing schedule will take approximately three days 
per class. However, each child will be tested no more than a total 
of an hour and a half, spread over two days. We feel this is a 
reasonable amount of time to impose on the children, but since the 
testing must be done individually, there is a real need for efficient 
scheduling in order to accomplish the testing in the time allowed. 

Within two weeks you should be receiving another communication 
from us with regard to certain kinds of information that are necess- 
ary to accumulate on each child in the Head Start centers. We are 
attempting to provide these forms to you prior to the start of the 
centers so that you will know what information has to be gleaned 
from registration records or inquiries of the parents. This form 
is a roster of the children in each class. Certain particular 
pieces of demographic information which are necessary in order to 
make meaningful summaries of test data are also requested. 

We share in the enthusiasm of Head Start in the opportunity of 
seeing what changes and affects can accrue to the children as a 
result of the planned variation program. It is our hope that some 
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of the evaluation procedures can be focussed specifically on the 
needs of each local community; the details of this arrangement 
will be pursued at the training sessions that you and your 
colleagues will be attending after Labor Day* 

Should you have any questions regarding our evaluation plan 
or schedule please do not hesitate to call me (collect) at 
(415) 326-6200 extension 2682. 



Very cordially yours, 




TOr Meeland, Ph.D. 

Sr, Research Psychologist 

Coordinator, Head Start Evaluation 



TBJ/ja 



Attachments 
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SCHEDULE OF TRAINING SESSIONS 
for 

HEAD START EVALUATION 



Community 



Date 



Chattanooga, Tenn* 

Walker Co., Ga and 
Albany, Ga. 

Tupelo, Miss 

Okaloosa, Fla 

Jacksonville, Fla 

Johnston County, N.C. 



Atlanta 



3-4 September, 1969 

1.00 P.M. 3 September 
to 

12.00 NOON 4 September 



Cleveland, Ohio 
E. St. Louis, 111. 
Wilmington, Del 
Morgan Community, W.D.C. 



Cleveland 



4-5 September, 1969 

1:00 P.M. 4 September 
to 

12.00 NOON 5 September 



Duluth, Minn., and 
St. Cloud, Minn. 



Duluth, Minn. 



3 September, 1969 



Oraibi, Arizona and 
Acoma, N.M. 



Phoenix, Ariz. 



5 September, 1969 



Tus kegee , Al abama 

Lakewood, N.J. , and 
Jersey City 

Portageville, Mo. 

Central Ozarks, Mo. 



To be arranged 



Note: You will be notified of the training session location at a later date. 
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OBJECTIVES AND SCOPE OF THE EVALUATION 
OF HEAD START PLANNED VARIATIONS 



The overall purposes of studying Head Start programs in a framework 
of planned variation are to: (1) compare the relative effectiveness of 
different education models in Head Start, and (2) assess the cumulative 
impact of a coordinated Head Start and Follow Through public school 
experience. 

The first year of the planned variation program in Head Start is 
viewed as developmental for both the programs and their evaluation. 
Evaluation objectives for 1969-70 are to: (1) document the implementation 
of the eight different sponsor programs in the sixteen communities in which 
they will be initiated, (2) collect baseline data on both participating 
and non-participating children and others influencing or affected by the 
program, and (3) obtain measures of changes that may be attributed to 
the programs, both within and between communities and models. Because 
of the developmental character of the first year, these latter measures 
of impact, of course, will be tentative. Objectives for subsequent 
years of the experiment may be stated only provisionally at this time. 

Three major tasks are anticipated during 1969-70: 

1. Providing objective information about the implementation of 
each sponsor ' s program. 

2. Evaluating the first year's impact of the programs on 
participating children, teachers, and parents. 

3. Establishing means for studying the longer term impacts, 

by linking Head Start experience with subsequent participation 
in Follow Through. 



During the first year of evaluation of planned variation in Head 
Start, the emphasis will be on developing evaluation designs appropriate 
to local situations, focussing particularly on children who are partici- 
pating in sponsored Head Start programs and other children who are par- 
ticipating in non-sponsored Head Start programs. The latter would serve 
as comparison groups to the sponsored groups. 

Measurement and Data Collection 

The measurement plan will seek to assay each sponsor program against 
the goals it sets for itself, as well as against the purposes of the 
national program. Necessarily, then, there must be not one evaluation 
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but many, for a specific program may demonstrate high effectiveness 
against one set of goals and lesser effectiveness against other sets. 

Within this framework, tests will be developed that seek to satisfy, 
at least preliminarily, program goals that were shared by all sponsors 
as well as goals that are unique to a single sponsor. Deteimining in- 
strumentation for initial measurement in the baseline year for evaluation 
of planned variation in Head Start is an issue that deserves fuJ 1 partici- 
pation by program sponsors as well as SRI and Head Start staff. The 
counsel and suggestions of local Head Start officials, CAP members, and 
parents will also be sought. 

A common core of information about children, parents, and teachers 
is needed and should be obtained through measures that are compatible 
with program effort in all locations. Some measurement may need to be 
unique to particular locations or programs. 

We suggest that the primary means for obtaining common-base measures 
on children be a battery of individual and group tests and inventories 
administered by staff accountable to SRI. Aides and Junior testers will 
be hired from the local community and Head Start parent groups to ad- 
minister some of these tests. Information about parents would be obtained 
through two principal means: (1) demograph^ic and other descriptive data 
obtained through structured forms completed at Head Start Centers when 
children are registered, and (2) household interviews conducted with a 
sample of parents or mothers. The main source of information about 
teachers and about program implementation would come from selective 
interviews with teachers and from observation of a sample of Head Start 
classrooms at each location. 

Timetable of Key Tasks and Reports 

Table 1 shows the expected schedule of performance on key tasks 
of the study, including provisions for reviews with sponsors. Head Start 
staff, and others (such as the USOE/Pollow Through staff) regarding the 
conduct of the study during this year and subsequent years when children 
in this study are enrolled in the Follow Through program. 
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i Tiable 1 

i 

SUBAMARY OF MAJOR PROJECT EVENTS 



Tasks 



Months 



Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug 



1. Planning 
meetings with 
sponsors and 
Head Start 
staff 

2. Selection of 
instruments 

3. Recruit and 
train testers 

4. Individual 
and gi*oup 
testing 

5. Pretest of parent 
interview schedule 

6. Parent 
interviews 

7. Classroom 
observations 
for implement- 
ation data 

8. Data reduction, 
tabulation, and 
analyses at 
Menlo Park 

.9. Reports to 
Head Start 



X 
X 



X X 



X X 



X X 



X X 



X 



X 



X X 
X 



X 



X X 



X X 



X 



X 
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STANFORD RESEARCH INSTITUTE 



To: 



Head Start Director 



Date: 21 August 1969 



From: Tor Meeland 



1. Although the enclosed forms are intended to be self explanatory it may be 
useful to make some comments about their application in your community. These Class- 
room Information Forms represent one way of formally identifying each child in each 
Head Start class and to array various bits of information on his or her background 
and family. We are providing them before your initial starting date (hopefully) in 
order that you may be alerted to the kinds of information that should be elicited 
from the parent during the time of registration of the child and to distribute the 
fox*ms to the teachers in the classes to be tested. Each class teacher should 
receive: 



The instruction booklets should be sufficiently complete to answer most questions 
that arise. If this is not the case, please call me (collect) at (415) 326-6200, 
extension 2682, or Mrs. Klara Evans, extension 2454. 

Should you or the teacher (s) determine that some item of information appears to 
be sensitive for any parti<2ular parent, please do not pursue the issue. There is no 
intention to pry into private information about any family. We are attempting to 
document relatively public information on the various characteristics of the children 
and families that will be tested in the Evaluation Program of Planned Variations in 
Head Start. As you will see in the instruction booklet, it is quite possible that 
some pieces of information are simply unavailable. We have noted on page 1 how 
missing information is to be coded. 

The SRI testers who come to your community shortly will examine the Classroom 
Information Forms and give whatever assistance is necessary for the accurate com- 
pletion of the requested information^ It* will be their responsibility to return 
the white form to us in Menlo Park, Calif*, and to leave the teachers two yellow 
copies for additions to their records and future reference during the year. One of 
the completed yellow copies is to be returned to us at the end of the program year. 

2. In anticipation of the assistance that our testers will require in your 
community, we would appreciate your locating two tester aides for each Head Start 
class that will be tested. We will pay the aides at an hourly rate which is the 
same as your local pay scale for work of this type. One aide in each class will 
be trained by our tester to give some of the simple tests to the children and thus 
it is desireable that this aide have a high school education. The second aide will* 
assist in some of the logistic activities associated with the testing program. 



4. 



3. 



Instruction booklet (6 pages) 
White Classroom Information Form (1 copy) 
Yellow Classroom Information Form (2 copies) 
Carbon paper (2 sheets) 
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To: Head Start Director 
From: Tor Meeland 



21 August 1969 



3. In each class we need to have the Molhe> s of on^— half of the children be 
available for participation in the evaluation piogram. The oetails of that par- 
ticipation will be described at the training session (scneduled according to my 
letter to you 14 August 1969) as will be the procedure for the selection of this 
half of the class* Each Mother will be occupied with her child for a period of 
approximately thirty minutes, althou^rh her total t:mo in absence from her home 
will be approximately one and one-half hours. 'Ve hcpe to be able lo provide a 
small honorarium to the Mother for her to use for payment of her babysitters as 
necessary. Transportation of the Mother to the Head StLVt '-enter will have to be 
arranged with your help. Our experience has slown that unless transportation is 
provided for the Mother, it is well nigh impossible to insure her appearance at 
the scheduled time. We hope her participation vith her hila will be a very sa»is 
fying event* 

Again, do not hesitate to call me collect if you have my questions about the 
use of the Classroom Information Forms. We look forward to meeting you at the 
training session. 



STANFORD RESEARCH INSTITUTE 



To: 



Distribution 



Date: 



27 August 1969 



From: 



T. Meeland 



Location: 



Subject: Updating Head Start Class Information 



Answering: 



To be sure that the evaluation design for each community is as tight and 
systematic as possible, we wish to confirm, where possible, certain features 
and conditions about the Head Start classes to be tested in the Evaluation of 
Planned Variations. 

The classes to be tested are identified in the attached listing along with 
certain descriptive characteristics. 

Please review carefully the information about the classes in your community 
and make all the necessary corrections. - In particular, we are concerned about 
columns "Any Previous Head Start" and "in 1970, They will go to": the children 
should have no previous Head Start (full year or summer) and we must have the 
best estimate as to the type of school they can be expected to enter next fall, 
in this community , i.e. , regular K or 1st grade or a Follow Through K or 1st 
grade (and who will be the isponsor) . Please return the list to me; the second 
copy is for your files. ^ 

TM: St 
Attachment 
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Appendix B 



SPRING 1970 COMMUNICATIONS 
CONTENTS 



Date 
♦25 Feb 70 

♦16 Mar 70 
♦30 Mar 70 

♦16 Apr 70 
20 Apr 70 

♦24 Apr 70 

* 4 May 70 

* 6 May 70 
6 May 70 

* 8 May 70 
♦13 May 70 
♦19 May 70 
♦16 July 70 



To 

HS Sponsors 

Distr B 
Distr C 

HSD 

HSD & FT 
Coord • 

SC 

HSD 

SC 

HSPV Spons 
SC 

HSPV Spons 
HSD 

HSPV Spons 



Subject 

Center Closing Dates and Evaluation 
Calendar 

Class Observation Plans 

Spring Pupil Testing Activities 
for HSPV 

Parent Questionnaire 

Reimbursement of Postage for Returning 
Class Observation Record Forms 

Various Left-Over Items 

Teachers Questionnaire 

Various II 

HS Video Tapes 

Tester Descriptions 

Ratings of Teachers by Sponsors 

Ratings of Teachers by HSD's. 

Teacher Goals and Classroom Schedules 



B-5 

B-9 
B-13 

B-22 



B-23 
B-25 
B-26 

B-29 
B-31 
B-33 
B-35 
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STANFORD RESEARCH INSTITUTE 



To: 



Head Start Sponsors 



Date February 25, 1970 



From: 



Tor Meeland 



Location: 



Subject: 



Center closing dates and Evaluation 
Calendar 



Answering: 



1. The first enclosure shows the last day of Head Start classes 
in each of the P. V. communities. These dates were obtained 
January 15-19 by phone calls to the communities. If your 
later contacts uncover changes in these dates, I'd appreciate 
a note frcan you to this effect. 

2. The second enclosure is a copy of our evaluation calendar 
for spring 1970. There are some changes in dates from 

what was given orally at the Head Start meeting February 10, 
1970. 
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LAST DAY OF SCHOOL FOR HEAD START CENTERS 



Date 



Vacation 



Nlmnlcht 



Cleveland 
Duluth 
St. Cloud 



Full Year 
6/5 
5/29 



8/3-9/1 probably 



Henderson 



LaFayette 
Albany 
Lakewood 
Jersey City 



6/2 (Depends on weather. 
Full Year 
6/15 
7/30 



Snow dates added) 



Bank Street 

Tuskegee 
Wilmington 

Becker & Englemann 

E. St. Louis 
Tupelo 



7/31 
5/29 



Full Year 
Full Year 



7/15-8/1 probably 

Closed 2 weeks in July prefers testing 
during May 



Bushell 



Oraibi 
A coma 

Portageville 



5/29 or 5/22 
5/29 
5/15 



Weikart 



Okaloosa 
Pensacola 
Central Ozark 



5/29, 
Full Year 
5/29 



- Vacations during summer months 
(Depends on weather. Snow dates added) 



Gordon 



Jacksonville 
Chattanooga 



Armington 



Capitol Head Start 
Johnston County 



Full Year 
6/5 



8/14 
5/29 



(Prefers testing 1-15 May) 



January 20, 1970 
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Spring 1970 
Calendar of Head Start Evaluation Activities 



Feb 2-13 Exemplar class observations in Portageville , Mo., 
E. St. Louis, Jacksonville, Ft. Walton Beach, Fla, 
Capitol Head Start, Washington, D.C. , Lakewood, N.J. , 
Wilmington, Delaware, Duluth, Minn. 

Feb. 16-27 Prepare final observation form and training manual. 

Feb. 24- Mail and telephone communication with the Joint Fellows 

Mar. 6 on the class observation data Jane Stallings collected 

Feb. 2-13. 

Mar. 3-5 Class observer training at SRI. 

Mar. 6-12 Class observation in Menlo Park and vicinity. 

Mar. 17-19 Training of Head Start class observers in cities to be determined. 

Mar. 23- Head Start Class Number of Classes to 

Apr. 8 Observations in; be Observed in; 

Planned 
Variation Comparison 

Duluth (Nimnicht) 3 3 (St. Cloud) 
E. St. Louis (Becker/ 

Englemann) 3 3 

Portageville (Bushell) 3 

Jacksonville (Gordon) 3 3 
Capitol Head Start 

(Armington) 3 3 

Lakewood (Henderson) 3 3 (Jersey City) 

Tuskegee (Bank Street) 3 3 

Ft. Walton Beach (Weikart) 3 3 (Pensacola) 

Note: These locations may change upon recommendation of 
the sponsor. 

Apr. 6-10 Distribution of Teacher Questionnaire to all teachers in P.V. 
and comparison classes. 
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Apr. ^O- 

May 1 Training sessions for spring pupil testing 

1. Phoenix (Apr. 20-21) for 

Oraibly Acomai N. M. 

2. St. Louis (Apr. 23-24) for 

Duluth/St. Cloud 
Central Oaarks 
Portageville 
£. St. Louis 

3. Philadelphia (Apr. 27-28) for 

Capitol Head Start 
Wilmington 

Lakewood/Jersey City 
Johnston County, N.C. 

4. Mongomery, Ala (Apr. 20-May 1) for 

Chattanooga 
LaFayette/Albany 
Tupelo 
Tuskegee 

Ft. Walton/Pensacola 
Jacksonville 

Note: The locations for the training sessions might change 
due to meeting room unavailability. 

Apr. 27- 

May 22 Pupil Testing 

1. Apr. 27-May 8 Portageville 

2. Apr. 27 - May 15 Oraibi (or May 4-22) 

3. May 4-22 All other communities 



February 13, 1970 



HaU: 1 6 Marcli 11^71} 

I.Mtion: Mi-nlo Park. Cn I i l oni t .. 
Antwcrtaf : 



Classroom Observation Plans 

The procedure for the classroom obnorvat ions Iuh gone* ihroiiKh two 
intensive months of review and refinement in c.finiunrl ion aiih the Kol l<iw 
Through sponsors who have propcrams in Hr;irt SI url IManm d Viu latiini and M 
now appears that the instrumc^nt is re«ipunslv<* ii\ i ach of lUv mtwI^-lH to sont 
degree. During the first half of February, Jane StallmK.s nnd Bocky Simons 
field tested the procedure in Head Start and Pol low Throiiich class« s In 
Portageville. East St. Louis. Jacksonville, F^rt Walton Deach, Lakewood. 
New Jersey, Wilmington and Duluth. We have Just, cooiplfted tho third round 
of refinement of the training procedure rhat will bo used to prc pMn 1 5u 
community-based observers we hope to employ to make the observations. 

Class observations will be done in selected communities* and will cov«jr 
both Head Start and Follow Through classes according to the schedule shown 
In Table 1. The Head Start and Follow Through classes will be ohH<*rvi*d for 
two successive days. The observer will bf in the class for thr wholr day. 
Some classes in Follow Through will have a third day of obHervatlon for 
rater reliability purposes. 

Two training sessions will be held between March 31 and April 9. 
according to the schedule shown in Table 1, Th'« clas^ obSn^rvatlons are to 
be completed within a three week period during April 6 - 30, 



* Selected primarily on' the basis of logistical considrrations* l.i:., 
travel costs and scheduling probU*ms of monitoring by SRI. providi d onch 
sponsor was represented* 




STANFORD RESEARCH 

To: Distribution B. 

From: Tor Mecland 

Subject: Classroom Obsen^ation Plans 



Class obs<?rvtj^ will be- hired from \ho locul oommuniius. hwumo iv; 
oiir team ami paid for Uvmp i.Nprnscs lor Iimv. ], i iu.. ir.Miiinj;. ,uhi : 
the class obs. rvations. Wr will :ipproc i at «• i h* asMsi.uKS. or i li. ul 
Start Directors and the Fol low ThrouKh Coordinators in i hos.- commiin 1 1 1 , s 
where class observations will be made in Identlfyinu ranilicJato obs. rv. r.s 
for us. The qualifications arr as follows: 

a. Have partictpatrd in Hiad Start or Follow Tlll•o^^^h class a<!t iviiv 
as a teacher, aidr or volimtoor. i.o. . had < xpt rimrc in class, s 
with young children. 

b. Be able to memoriz^r a list of about 3r) cod.-s Miii wiM bo u«od 
in recording the class activitios. 

c. Should not be an employee of tho school district (or Head Start 
program) . 

d. Be able to keep records carefully, 

e. Experience and education in testing and obs*- r/ar ions would be 
desirable, but arc not necessary. 

f. Sufficient free time? to attond tho trainiiif^ session (sei- Tablo I 
for dates and location) and to devoto up to ( i vo hoars a day for 

14 days maximum, during the class observation period, April 6 - :«). 

Selection of classes to be observ.d in each rommunity will Ur doiu- Uv 
SRI in conjunction with the sponsors in the case of Uu Plann<*d Variation 
classes and the Sponsored Follow Through classes. For the comparison 
classes In H<?ad Start and Follow ThrouRh, we ner-d your counsel on which 
comparison classes should be observed. We prefer that the teachers s< licted 
are good teachers with respect to the teaching styles or procedures that are 
in use in the District. 

Coordination between SRI and the sponsors and communities listed in 

Table 1 has begun by phone by Margaret Carroll. (415) 326-(i200r ext . 4367. 
in order to give an early alert on the need to recruit observer trainees. 

explain the s^^lection procedure further, and the piy ami rcimhursemcnt 

procedures that will bc» used. 
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UJCATiONS KOK CLASS OliSKUVAT ii A.'-. 



la:r:e^ lo be Obsorvocl 



(1) =In Soar's study 






Vol |m. • 


1 1 

1 1 

1 










lio:ul Stiirt 


Ff> I low 
ThrcMiuh 


rum- 
p:i ri son 


Tul .1 \ 


No , M » 


Sponsor 


City 


Exp. 


Cp. 


K _1 j!^ 


_ K J 


Cl.iss. > 


oils, i v 


NimniCnC 


Du'iuth, 
Minn. (1) 


3 


3 

(St. Cloud) 


2 2 2 


2 2 2 


18 


5 


Henderson 


LaFayette, 
Ga. (1) 


3 3 
(Albany) 


2 2 


2 2 


1 1 


1 


Bank Street 


Tuskegee, 
Ala. (1) 


3 


3 


2 2 


:i 2 


1 1 




Uecker/ 
Engolmann 


R. St. liouis, 
III. (1) 


3 


3 


2 2 


2 r> 


11 


1 


Gordon 


Jacksonville, 
Fla. (1) 


3 


3 


2 2 


X 0 


12 




£i3C 


Morgan, 
Wash. D.C. 


3 


3 


2 


2 


K, 




Bushel 1 


Portageville, 
Mo. 


3 


3 


2 2 


2 2 


14 


4 


Weikart 


Okaloosa, Fla. 


3 3 
(Pensacol a) 


2 2 


2 2 


11 1 



Training Ses sions 
A. 



St. Louis, Mo. (Mar. 31-Apr. :^) 
Sheraton-Jefferson Hotel 
415 No. 12th St., St. Louis, Mo. 
Duluth 

E. St. Louis 
Portagevi He 
Morgan 



AMnnla. Ga. (Apr. <i - 9) 

Quality Hotel Centrnl 

100 Tenlh St. N.W. . Atlanta, 

L;i Kay<'t to 

Tuskoj^re 

Jacksonv i 1 lo 

Okaloosa 



Ga. 



O j 

ERIC 



B 



-ii90 



V 



Distribution D 



Follow through Coord inaLors 



Head Start Directors 
Copies : 

Follow IhrouRh (Dr. Judy Crooks - 
Head Start (Dr. Lois-ell in Datra) 
Sponsors 
Joint Fellows 

Head Start Regional Directors 

Chicai^o 

Atlanta 

Charlottsville 

Kansas City 
SRI Regional Representatives 
SRI Project Staff 
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To: 



5iAlNHJKU KbbkAKCH INSlii UTi: 

Distribution C Marc h :u) , |f>7o 



From Tor MeeXand LocAtion: 

Subject: Spring Pupil Testing Activities for Head Amwerint: 
Start Planned Variation 



Introduction : This document describes the plans and procedures thnt will 
be used to implement the Spring Pupil Testing (the Post Tests), Since the 
fall '69 testing, many of you have made numerous suggestions for improving 
the procedures and the tester organiacation in order to reduce to n minimum 
the demands placed on the local Head Start offices and personnel and to 
increase the quality of the data collected. The changes that have been incor- 
porated reflect an earnest attempt to respond to these suggestions. 

A. Test Coromunities 

Pupil testing will occur in twenty different communities as shown in 
Table 1. It can be noted that Cleveland will not be Included in the spring 
testing and it is hoped that testing can be resumed there by next fall. 
Where double entries appear, e.g., LaFayette/Albany, Ga. , the second community 
contains the comparison classes. 

B. Test Schedule 

The duration of Head Start Programs in the twenty test communities 
ranges from 8-12 months. In half of the locations, classes end by June 1, 1970; 
Portageville closes May 15 (by our current records). In order to avoid any 
testing during the last weeks of classes (in most locations) and to provide 
a three-^week period in which to complete 10-13 actual days ol testing, the 
basic test period will run from May 4-22, 1970 (Portageville. April 27 -May 8). 

C. Test Battery 

The pupil test battery will be the same as used in the fall and will include: 

1. The Stanford-Blnet 

2. The 8-Block Mother-Child Interaction 

3. The Pre-school Inventory (PSI) 

4. The NYU test of: 

a) Pre-science, pre-math, and prepositions (Booklet 3D) 

b) Letters 9 Numerals and Shape Names (Booklet 4A) 

5. Motor Inhibition Test (Beam Walking, Truck Pull and 
\ Line Drawing) 

During the period when the mothers are present for the 8-Block test, 
: a PARENT QUBSTIONNAIRE will be administered. The items of information have 

\ ; }yeen approved by Head Start, Wash. D.C. A similar form has been administered 

I to over 15,000 parents In the Follow Through Evaluation. A brief field trial 

of the PARENT QUESTIONNAIRE helped simplify the form, eliminate awkward and 
unclear items and demonstrated that about an hour is needed to complete the 
questionnaire (actually the time ranged from 45 minutes to an hour and a half). 
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TABLE 1 



Pupil Testing Dotes 









PUPILS 


TO BE 


TESTED 


SPONSOR 


OOMMUNITY 


TEST PERIOD 


BINET 8« 


-BLOCKS 


AUXILIARY 
BATTERY 


Nimnicht 


Cleveland 












Duluth 

- St. Cloud 


May 4-22 
II 


40 
26 


33 
25 


72 
46 


Henderson 


Lafayette 
- Albany 




78 
42 


47 
23 


139 
61 




LakeWood 

- Jersey City 




50 
46 


38 

33 


112 
97 


Bank Street 


Tuskeffee 




1 ni 


1 no 






Wilmington 




129 


116 


240 


Becker & 
Englemann 


K. St-. T^uis 

Tupelo 




DO 

99 


HO 

65 


136 
168 


Bushell 


Oraibi 
- Acoma 

Pbrtageville 


April 27 
- May 8 


53 
23 

131 


22 
67 


47 
136 


Weikart 


Okaloosa 
- Pensacola 


May 4-22 


21 
29 


19 
29 


41 
57 




Central Ozark 




105 


106 


248 


Gordon 


Jacksonville 




55 


44 


94 




Chattanooga 




74 


33 


103 


Armington 


Morgan Community 


57 


35 


98 




Johnston Co* 




75 


59 


140 
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Prior to the test period, a copy of the PARENT QUESTIONNAIRE will bo 
sent to you for your information and if you consider it appropriate to review 
it with your PAC Chairman, please do so. We will not have time to rcprlat 
with changC9| but it will be possible for you to alert the intorviower of any 
items you believe may cause difficulty. However, in order to maintain consis- 
tency in the data collection procedure, it is most important that the items 
are not shown to or discussed with the mothers who participated in the 8-niock 
test last fall - they will be the interviewees. The reason for this caution 
is the need to avoid premature formulations of responses and to avoid last 
minute discussions and interactions that could inadvertently shift any parent's 
view. 

A similar caution is applicable to the pupil test battery and its contents. 
Although each child experienced similar tests last fall and the teachers were 
generally well aware of what those tests included, it would be most disadvan- 
tageous to the objective intent of the Planned Variation Evaluation if the 
teachers were reminded of the contents of the test battery listed above for 
fear that there could be an innocent "pointing" toward the tests. In short, 
please don*t spill the beans. 

D. Pupils to be Tested 

The tests will be given only to those children who were tested last fall. 
If a child took Mijr of the tests then, he will be retested even if the original 
test(s) were incomplete. Children who Joined the class after the fall tests, 
or missed all tests, will not be post-tested. Table 1 shows the total number 
of pupils who were tested last fall. It ts expected that the attrition due 
to family moves, withdrawals and absences will be about 10-12%. 

E. Testers to be Used 

Changes have been made in the numbers and types of testing persons that 
will be used and also in the orgfoiization of the testing teams. In each 
community there will be five kinds of testing personnel involved. Their 
titles and duties are as follows: 

1. Site Coordinator - This is a qualified Binet tester with other 
testing experience and background who will spend one week at SRI, April 13-17, 
becoming fully familiar with every aspect of the testing program. He will 
be responsible for training the four types of testers that will work in each 
community. (For cost and logistic reasons, the 8-Block testers will be trained 
by SRI at two central training sessions.) The Site Coordinator is also respon- 
sible for adherence to the specified test procedures by all his testers and 
he must personally review all the test data forms for completeness prior to 
shipping them back to SRI. 

The scheduling of the tests and leslers is his responsibility in coordination 
with the Head Start Director. We hope that the presence of the Site Coordinator 
can eliminate almost all of the testing-related inconveniences that the 
Directors faced last fall. Since the Site Coordinator is not from the center's 
neighborhood, it may be difficult for him to arrange the testing time appoint- 
ments for the "8-Block" mothers. We are trying to make arrangements for him 
to be able to hire a local person for a short time to give him assistance 
and thus further reduce the demands on Dii'ectors. The Site Coordinator will 
also be responsible for seeing that the pay forms for the locally hired 
testers are completed and submitted to SKI correctly. 
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2. Blnet Tester - The number of Dinct testers ^o be used in each 
community varies according to the number of children co be tested. Table 2 
shows how many will be used at each location. This person will give Binets 
only and will be supervised and scheduled by the Site Coordinator. 

3. Auxiliary Battery Tester - This person was called the Jr. Tester 
last fall. She will administer the Auxilinry lint lory (Hooklel 1A , RSI 
and Motor Inhibition). In Table 2, you can see how many are needed at each 
location. It would be desirable to use the same Jr. Testers of last fall 
in this position and we would appreciate /it if the Directors could select 
now the persons to be the Auxiliary Ra t tcry Tcslcrs. If wo wait uutll the 
Site Coordinator completes his training at SRI and then goes to the center, 
it will be too late to employ the Auxiliary Bat lor Toslers. The Silc 
Coordinator will train, supervise and schedule them. The pay rate will be 
the same as for the Jr. Tester position of last fall. A two-day training 
session will be conducted by the Site Coordinator during the week prior to 
the beginning of the pupil testing. 

4. 8"Block Tester - This will be a person from the local community who 
will be selected by the Director, paid by SRI on a consultant basis and trained 
aaring a three-day period in either St. Louis (April 22-24) or Atlanta (April 27-29). 
The procedures and forms for the 8-Block test have been simplified and video 

tapes are now available for training purposes. 

In a very few instances, the class observers who were trained by SRI 
will have completed their observations and thus could be available to do the 
3-Block, but generally this is not so. The number of 8-Block testers needed 
in each community is shown in Table 2. We request that the Director select 
the persons for this position; contract forms and instructions will be sent 
separately. The qualifications for the 8-Block tester are: 

a. able to learn a testing procedure. 

b. not presently a paid worker in Head Start. 

c. able to attend a three-day training session as follows: 

1) in St. Louis, April 22-24, at the Sheraton Jefferson Hotel for: 

* Duluth 

* St. Cloud 

* Lakewood 

* Jersey City 

* Wilmington 
East St. Louis 

* Oraibi 

* Acma 
Portageville 
Central Ozarks, Mo. 

* Morgan (Wash. D.C.) 
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Table 2 





TESTERS 

• 


TO BE USED 


IN EACH COMMUNl'IT 














Auxiliary 


Sponsor 




Ri not 


8-Block 


Parent 


Battery 


Communi ty 


Testers 


Testers 


Interviewers 


Testers 


Nimnicht 


Cleveland 




- 






Dulu th* 


1 


1 


1 


2 




St. Cloud 


1 


1 


1 


1 


Henderson 


Lafayette* 


3 


1 


1 


J 




Albany 


2 


1 


1 


1 




Lakewood- 


2 


1 


1 


9 




Jersey City 


2 


1 


1 


2 


^Bank Stfreet 


Tuskesee 




2 


2 






Wilmington 


4 


3 


3 


4 


Becker and 


E. St. Louis 


2 


1 


1 


3 


En 1 em Aim 














Tupelo 


3 


2 


2, 


3 


Bushell 


Oraibi- 


2 


1 


1 


w 




A coma 


1 


0 1 


1 


1 




Portageville 


4 


9 




3 


Weikart 


Okaloosa-* 


1 


1 


1 


1 




Ptosacola 


1 


1 


1 


1 


i 


Central Ozark 


3 


2 


2 


4 


Gordon 


Jacksonville 


2 


1 


1 


2 




Chattanooga 


3 


1 


1 


2 


Arming ton 


Morgan Community 


2 


1 


I 


2 




Johnston County 


3 


2 


2 


3 
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2) in Atlantai April 27-29| at .the Quality Hotel Central for: 

LaFayette j 
Albany j 
Tuskegee 
Tupelo 

* Ft. Walton Beach 

* Pensacola 

^ Jacksonville 
Chattanooga 
Johnston County, S.c. 



* Air tickets will be supplied to testers from these locations. 
Others will be reimbursed for car travel at 10 cents per mile. 
Rooms and subsistence will be provided along with reimburse- 
ment for travel expenses. Details will come separately. 

d. free to administer tests for up to 12 days during the period 
May 4 - 22. (Port agevi lie: April 27 - May 8 only). 
The 8-Block testers will be paid for training and testing time at a rate of 
20% higher than the Auxiliary Battery Testers. After the training session, they 
will be supervised and scheduled by the Site Coordinator. 

5. Parent Interviewer - This person should be the same caliber as the 
Auxiliary Battery Tester and will receive the same rate of pay. She will 
administer the PARENT QUESTIONNAIRE to tte mothers who participate in the 
8-*Block testing. Her one day training wm^ be given by the Site Coordinator 
during the week, prior to the pupil testing^^ She will be supervised by the 
Site Coordinator, There must be one Parent Interviewer paired with each 8-Blbck 
Tester, We request that the Director select the Parent Interviewer(s) . 

6- Summary of testing team makeup . The testing team for each community 
consists of several types of persons. Using l^pelo as an example, the 
structure appears as follows: 



I Head Start 
Director 



jpield Supervlsoij - from SRI staffs in charge of 5-6 Site Coordinators 

Site CpordinatoH ^ in charge of all testing, selected by SRI and 

supervises: 





Binet Testers! - selected and assigned by 

SRI, trained by Site 
Coordinator* 



B^-BIock Testers! - selected by the Director, 

trained by SRI staff in 
Atlanta. 



Parent Interviewers! - selected by the Director, trained 

by Site Coordinator in Tupelo. 

Auxiliary Battery Testers! - selected by Directori trained 

by Site Coordinator in Tupelo. 
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F. Honoraria 

Upon completion of the 8-Block test and the PARENT QUESTIONNAIRE, each 
mother will be given an bIDnorarlum of five dollars. 

G. TiBst Kits 

will send test kits to each Director to be held for the Site Coordinator. 
Tne Site Coordinator will have the keys to these kits. The 8-Block testers 
will receive their materials at the training sessions. The Site Coordinator 
is responsible for packing and shipping the kits back to SRI. 

H. Testing Pixjcedure 

Name 'lists will be provided to the Site Coordinator and Director which 
will identify each child who is to be tested. Depending on the local schedule, 
it may be necessary to add thirty minutes to the beginning and/or end of the 
class day in order that the testing can be completed before May 22 (May 8 in 
Portageville) • The scheduling of centers and classes to be tested is to be 
coordinated with the Directors. A preferred order of testing will be in the 
hands of th^ Site Coordinator. The order in which children in a class should 
be tested will be prescribed by SRI and must be followed. 

I. Critical Dates 

Several dates are mentioned in the preceding sections. Table '» sum- 
marizes them in pseu-calendar form. 

J • Final Comments 

In several instances I was given reports that the testing conditions for 
specific children were less than desirable or acceptable. In most cases these 
reports were substantiated by the entries in the Testers Logs which Included 
the beginning and ending time of each test given to each child, errors, omlsB4.ons 
or changes in procedures, description of the testing circumstances and finally 
an appraisal by the tester as to the acceptability** ot t'iie responses or 
scores made. 

Each tester has been evaluated according to mechanical completeness of 
his test recordings and the reports on his perfoxmance given to us by the 
Directors, the Field Supervisors, and others. We have dropped several Binet 
Testers who did not perfoxm to our satisfaction. In the case of the Jr. Testers ^ 
we will send to the Directors the names of the Jr. Testers from last fall that 
we will not re-*hire as Auxiliary Battery Testers. 

Last fall we had several instances where payments were delayed. We hope 
that the presence of the Site Coordinator will eliminate any future delays. 
Most often the delays were due to lack of signatures, incomplete Activity 
Reports (we couldn*t tell who did what where!), or a person misspelling her 
name (or spelling it differently from her W-4 form) . 

If you have any comments or questions about these spring testing plans, 
please send them to me by mail or phone (415) 326-6200 ext. 2682. I have 
tried to bring you abreast of our plans; if changes are made, I hope they aze 
minor ones— *and I will send them along to you. 
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Table 3 

CRITICAL DATES FOR HEAD START TESTING. Sprlne '70 



Date 
A pril 5 
6 
7 
8 
9 
10 
11 
12 
" 13 
14 
IS 
16 
17 
~18 
_19_ 
20 
21 
22 
23 
24 
25" 

26 

27' 
28 
29 
30 
1 

2" 
3 

4" 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15_ 
16 
17 
18 
19 
20 
21 
22 



■Directors to receive SRI contract forms and Instructions for the 

8-Block Testers 



Directors to <1) send to SRI the signed contracts (4 copies) of the 

8 Block Testers.' and 
(2) Call in (collect) the names of the 8 Block Testers 



/ 



(so pre- ticketing can be done) 
^Training Session at SRI for the Site Coordinators 



Directors to have selected the Auxiliary Battery Testers 
and Parent Interviewers 



Training of Aux. Batt. 
Testers El Parent Inter- 
viewers — in Portageville 



L I 8 Block Training 
y'\ in St: Louis 



May 




in all other 
locations 



8-Dlock Training 
in Atlanta 



Pupil testing in Portageville 



Site^ 



Site' 
Coordinators 
to coord i • 
nate with 
Directors 



Pupil testing in all 
other locationr. 
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Distribution C 



Head Start Direct tors (2) 

lot. Lois-ellen Datta (4) 

Planned Variation Sponsors 

Head Start Regional Directors (3) 

Atlanta 
New York 
Chicago 
Kansas City 
San Francisco 
Charlottesville 

SRI Field Supervisors 

Site Coordinators 

Project staff 

Policy Reviev Oomittee 



Information copies to: 

Joint Fellows 
Conunity people 



mo 



STANFORD RESEARCH INSTITUTE 
'^^^ Head Start Directors Dite: 16 April 1970 



From: Tor Meeland 
Subject: Parent Questionnaire 



Locition: 
Answering: 



Enclosed are two copies of the Parent Questionnaire which are to be 
administered to each mother who participates in the 8-Block Mother-Child 
Interaction Test. 

In my memo of 30 Blarch 1970 (pages 1 and 3), it was suggested that 
you share the questionnaire with the PAC Chairman and if you conclude that 
any items may be difficult or troublesome, please discuss the issues with your 
Site Coordinator. Below is a list of the site coordinators who will be in 
contact with you during the period 21-27 April for coordination of the spring 
testing. 

SITE COORDINATOR ASSKaiHENTS 



Duluth 

St. Cloud 

LaFayette 

Albany 

Lakewood 

Jersey City 

Tuskegee 

Wilmington 

E. St. Louis 

Tupelo 



John Berg 
Becky Simon 
Dennis Carringer 
Edward Ritter 
Rick Grippaldi 
Mary Lou Bizzaro 
M]rrtle Adams 
Barbara Bonner 
Cindy Souza 
Russell Mapp 



Oraibi 
Acoma 

Portageville 
Okaloosa 
Pensacola 
Central Ozark 
^Jacksonville 
Chattanooga 
Morgan Comm. 
Johnston Co. 



Ann Smith 
Marlene Venardos 
John Scott 
Naomi Bias singi lie 
Naomi Blassingille 
Ollie Bradshaw 
Richard Marotta 
Malinda Ray 
Marie Bowen 
Douglas Brennan 



Copies: 

Dr. Lois-ellen Data (4) 

Planned Varijation Sponsors 

Head Start Regional Directors (3) 

Atlanta 

New York 

Chicago 

Kansas City 

San Francisco 

Charlottesville 
SRI Field Supervisors 
Site Coordinators 
Project Staff 
Policy Review Committee 

Information copies to: 
Joint Fellows 
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STANFORD RESEARCH INSTITUTE 



To: 



Site Coord iK» tors 



Date: 



4/24/70 



From: 



Tor Meeland 



Location: 



Subject: 



Various Left-over Items 



Answerini: 



1. A complete copy of the 8-Block Manual was sent 4/23/70. It is pre- 
punched to fit your notebook'. 

2* The record sheets for the 8-Block Test are being distributed to the 
testers at the training sessions in St. Louis and Atlanta by Klara 
Evans. Klara will also give the 8-Block testers an extra 25 copies 
to be handed to you for reserve.. 

3. Stop watches for the Auxiliary Battery Testers were packed in your 
Test Kits. The watdies for the 8-Block testers will come in one of 
the beinfc sent to the Head Start Directors. 
(Duluthi ncuma and Jacksonville material will be sent to John Berg, 
Marlene Venardos and Dick Marctta, respectively, as requested.) 

4. Cindy Souza will be the Site Coordinator for East St. Louis. Becky 
Simon, who accompanied Jane Stalling on her Eight City trip for the 
class abservation pre-tests, will the Site Coordinator for St. Cloud, 
Minnesota* 

5« After the close of tiie meeting last Friday, I could not find any copies 
of the class lists which were to be forwarded by me in order to reduce 
suitcase packing problems. If anyone needs copies of his class lists, 
let me know. 

6* Because the name labels were undersize, a revised set of identification 
data was printed. The 10 digit code shows the. sponsor, location, school 
(or center) teacher and child's number. The description is printed on 
a single label at the beginning of each class. For example: 



On the child* s label, there is a 3 digit number which represents a 
computer word code — ignore it. 

I was Just informed that many **8-Block'* labels were printed and not 
enough (or any) **Binet" labels* Simply cross out any test name that is 
wrong and use the label. 
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To: Site Coordinators 
From: Tor Me el and 



4/24/70 



7. The rules for testing children are as follows: 



If these tests Administer these 

have astericks tests 





Auxiliary 
Battery 


Binet 


8-Block 


Auxiliary 
Battery 


Binet 


8>Block 


a 








no 


no 


no 


b 








yes 


no 


. no 


c 








yes 


yes 


no 


d 








yes 


no 


yes 


e 








yes 


yes 


nc 


f 


♦ 






yes 


no 


yos 


S 








yes 


yes 


yea 


h 








yes 


yes 


yes 



However, Portageville has some exceptions as noted on the class lists 
sent to John Scott « 

8. A large envelope was sent Tuesday by Cindy and included a contents list, 
labels, envelopes, memo sheets, dividers, expandable files, etc« If 
you have not received it, please inform me* 

9. Reminder: Be sure to avoid testing all the sponsored (Planned Variation) 
classes before (or after) the comparison classes. 

10. There seem to be many shippers/truckers* strikes occurring around the 
nation and this will cause delays in shipments. Please be patient. 

11* Cheers! 




STANFORD RESEARCH INSTITUTE 



To: 



Head Start Directors 



Date: 5/4/70 



From: Tor Meeland 



Location: Menlo Park, Calif* 



Subject: Teacher Questionnaire 



Answering: 



An integral part of the evaluation activities for Planned Variation is the 
systematic collection of certain information from the teachers of the classes 
used in the evaluation. This includes both the Planned Variation teachers and 
the teachers of Head Start classes that constitute the comparison group. 

As described below, will you please distribute the Teacher Questionnaires 
as soon as you receive them so that they can be completed by the teachers with- 
in five days and then returned to me in the envelopes provided. A copy of the 
questionnaire is attached to this memo for your information and records. If 
you notice anything in the questionnaire or the procedures given below that 
might cause any difficulty, please contact Jean Lotridge (or Virignia Holly) 
at (415) 326-6200 extention 2613. If it is more convenient, talk to the 
Site Coordinator who in turn can contact Jean Lotridge. 

1. Materials One Teacher Questionnaire is provided for each teacher along 
with an addressed, stamped envelope for the teacher to return the com- 
pleted questionnaire to SRI directly. 

2. Distribution of the Questionnaire to each teacher should be made by 
you. If you distribute the forms at a teacher's meeting and also 
provide time for them to complete the questionnaires, please do not 
permit any discussion of It to take place until after the forms are 
completed. The'^time required should be less than an hour. 

Return of the completed questionnaires should be done by each indivi- 
dual teacher. She should first check to make sure each qiestion has 
been answered ( please remind them not to miss any item) , and then seal 
it in the return stamped envelope provided. 

3. If any teacher has a specific problem in completing the form, she 
should call Jean Lotridge (415) 326-6200, extension 2613 collect. 



Thank you in advance for your efforts in distributing the Teacher 
Questionnaire. 

CCS Lois-ellin Datta 4 
ARD*s 3 
Sponsors 

Policy Review (k>mmittee 

Project Staff 

Joint Fellows (Info copy) 
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STANFORD RESEARCH INSTITUTE 



< 



To: 



Site Coordinators 



Date: 



May 6, 1970 



From: 



Tor Meeland 



Location: 



Subject: 



Various II 



Answering: 



2. 
3. 



4. 



Teacher Questionnaires have been sent to the Head Start directors for 
distribution to each Planned Variation and/or comparison teacher in her 
community . 

A copy of the Questionnaire and the covering memo to the Head Start 
directors is enclosed. We suggested that any difficulties be channeled 
through you to SRI (Jean Lotridge) . 

On May 15th, please remind the Head Start director to check if the teachers 
have completed and mailed the forms back to SRI. 

Attached is a cumulative list of mailings that have been sent to you. If 
you have a gap, tell Margaret Carroll so we can complete your records. 

Since we use the address you gave us during S.C. training session at SRI, 
you may not receive things promptly when you are on a remote site for the 
testing. You might, periodically, ask the Head Start director if she has 
had any recent communication from us that you could see. 

Our most recent address list for Head Start is enclosed. Lists such as 
this go out of date quickly and always include a clerical slip-up or two. 
If you dee any mistakes, send a correction to me. The "other contact" 
column consists of some persons we dealt with last August and September , 
surrogate Head Start directors and the inevitable "miscellany/* 

In case we fail to get detailed return shipping instructions to you, do 
the following: 

a. Pack everything in the footlockers. If there is an overflow, 
throw away single sheet forms (they are cheap to make) that are 
blank , so you don^t have to be troubled with a supplemental 
package. It would be convenient for us if you put all the completed 
forms for each class together along with the "Record of Tests" form. 
Use the foam pieces to pack the materials tightly. Loose packing 
can make a mess\of some of the items. Put all the stop watches 

in your own kit, if possible. 

b. Call the air freight office at the nearest commercial airport. 
Arrange for thea to pick up your footlockers. 

c. Ship them to SRI COLLECT using trie return labels in the kits. 




From: Tor Meeland ' May 6f 1970 

Page 2 



d. On the day they are picked up, please send me a postcard or 
letter stating how many kits were returned (give the kit 
numbers) and the date of the pickup. If we don't receive 
your shipment in :?ive days from the pickup < we will institute 
a foliowup. 

6 . Weekly Reports of Number of Tests Given 

Head Start, Washington, D.C.,now requires me to report each 
Tuesday on: 

a. The niunber of each type of tetits given and 

b. Problems, if any, at any site. 

Please call Dorothy Stewart (415) 326-6200, ext. 4210 on Mondays 
(11, 18, 25 May and 1 June) a tally of the number of tests given 
(Binets, 8-Block, Auxiliary Battery and Parent Interviews). 

7, Head Start Director Reports 

Head Start, Wa«hington, D.C., has requested that I ask each Head 
Start Director to give me a report on the testing procedure^ conditions 
and organization. I will write each Head Start Director to do this and 
suggest they use a copy osf our Tester's Log for entering their comments. 
Will you please give your Head Start Director a copy of the Testers 
Log so she can begin her records. Tell her to use the white pages for 
comments specific to any test occassion and the yellow pages for overall 
comments and suggestions. Also, please tell her that a note from me 
is forthcoming, but it may not arrive until next week. 



CUMULATIVE LIST OF MAILINGS TO SITS COORDINATORS 



Item 



Date Mailed 



Description 



Given to yc^u at SRI 
April 13, 1970 

Given to you at SRI 
April 13, 1970 



March 31? 
April 6 

April 17-21, 
1970 



2. April 17-21, 
1970 



3. April ?0, 
1970 

4. April 24, 
1970 

5. April 21, 
1970 (?) 

6. May 4, 1970 



7. May 6, 1970 



Copy of memo to Distribution B 
"closed observations'' 

Copy of memo to Distribution C 
''spring testing activities" 

Site Coordinator Test Kit and 
supplemental package (for overflow 
items that wouldn't fit in the kit. 
(1 each) 

Test Material Kits isent to Head 
Start Directors (generally) . 
vl-4 each) 

Supplemental envelope of forms ^ 
labels, etc. sent by Cindy Souza 

Memo from Tor, "Various Leftover 
Items." 

Copy of memo i;o Head Start Director , 
from Tor, "Paront Interview." 

Copy of memo to Ve&d Start ?)irectors, 
from Tor, "Teacher Questionnaire" 
(with. 1 copy of the questionnaire) 

Memo from Tor, "Various II," 
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STANFORD RESEARCH INSTITUTE 
To: Site Coordinators D^tc: May 8, 1970 

From; Tor Heeland Locition: 
Subject:Te8ter Descriptions Antwering: 



We need to summarize certain characteristics of the testers used last fall and 
this spring. The fall data are on hand (with some gaps, naturally) and I would like 
to receive from each of you a description of each tester you are using for the spring 
pupil tests. 

The forms enclosed will make the task easier for us and hopefully for you. 

Instructions Enter tester's name on a line and complete the information needed as 
follows : 

Field 1. Check the type of tester she (he) is. 

Binet = Binet tester. 
8-*Block *= 8 Block tester. 
Auxiliary = Auxiliary Battery tester. 

Aide = The aide you use for adminstration matters 
(scheduling of parent, etc. )|if you use one. 
Parent Interview s Parent Interview. It is possible that a double 

entry is appropriate here in 1 or 2 cases. 

Field 2. Give the age to the nearest year, if you know it. If you estimate the 
age, put parentheses around the number. If you do not know the age, 
enter a dash. Please try for an estimate, at least. 

Field 3. Use H = male; F = female. (Please, no estimates or unknowns) 

Field 4. Ethnicity. Check the column that is most appropriate. If in doubt, 
put parentheses around the check. 

Wh = White/Caucasian 

E)l s Black/Hegro 
Hex = Mexican^American or Puerto Rican or Cuban. 
Ind = American Indian 
Other = Check this column if the above doesn't apply. 



Field 5. Tears of Education = Tears of Education completed. Please enter the 
grade completed i.e., 

1 2 3 4 5 6 7 8/9 10 11 12/13 14 IS 16/^^7 18 19^ 
Grade School^ High School College ^ Haate^s Doctorate 
Graduate Graduate Graduate Complete 



Field 6. Ethnicity of Pupils - Do not use this field; it is simpler for us to 
enter the percentages. 

Return the completed foras ( inaide your Site Coordinator logs) along with all the 
test material when you are finished testing. 

Thanks in advance for your effort. 4rm 
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STANFORD RESEARCH INSTITUTE 
Head Start Planned Variatlcm Sponsors i>it«: May 13, 1970 

From: Tor Meeland Location: 
Sui^Mt: Ratings of Teachers by Spontors Aiuweili«: 



At the last Head Start Sponsors aeeting in Washington we noted briefly that 
it was isportant for us to obtain fron each Bead Start sponsor ratings on how 
well each teacher is iapleaenting the sponsor *s aodel. 

The enclosed forms should be easy to use. The teachers in your Itoad Start 
prograa are listed in order to reduce your efforts and also as another check on 
the accuracy of our records. The naaes are fron fttll '89, and do not reflf»ct 
naae changes due to a«rriage, etc. nor axe the replacement teachers* names sub- 
stituted. Update the recordst please! I£ you made changes In ieachs^s, please 
note the date of replacement. 

As you use the forms, consider what changes should be made in order to 
apply them to your stable of FdIIow Ihrouffh Teachers and send your recoMendations 
to me. We know that some of you have so aany teachers that no single person can 
reasonably rate thes. 

Ratings of the Head Start comparison teachers will be done by the local 
Head Start Director. A copy of this form (green) is enclosed for your information. 

Please return the completed yellow forms to me by May 29, 1970 ~ an 
envelope is provided. 
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Communt ty 



Sponsor 

We need your Judgment as to how well your teachers implement your 
model. The table below contains the teachers' names and the centers or 
schools in which they teach. Please rate each of them for three time 
periods: . 

Code to Use 

0 = Her performance as of October 1, 1969. 

M = Her performance as of May 1, 1970. 

P 3 Tour prediction of how well she will do next year 
(by Hay 1, 1971). 



Center / School Teacher 


Not 

Accept- 
able 


Barely Completely 
Acceptable Acceptai)le 

-1^ V 




0 


123456789 




























































































0 


1 2 3 4 S 6 7 8,9 



1 

2 
3 
4 
S 
6 
7 
8 
9 
10 
11 
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STANFORD RESEARCH INSTITUTE 



To: 



Head Start Directors 



May 19, 1970 



From: Tor Meeland Location: 
Subject: Ratings of Teachers by Head Start Directors Answerins: 



The purpose of the enclosed green form is to provide you with a simple 
means for recording your Judgment on how well the Head Start teachers in the 
SRI Evaluation Study of Planned Variation performed. 

Copies of two memos are Included for your information: 

1. To Head Start Planned Variation Sponsors (May 13, 1970) from 
Tor Meeland I and 

2. To Assistant Regional Directors (May 15, 1970) from Dr. Lols-ellln 
Datta 

On the green form we have entered the names of your teachers whose classes 
we have tested. Please rate each teacher according to the instructions given 
on the form. 

If the names have changed due to marriage , replacement , etc., please 
correct the name and if it is a new teacher please note the date of the re- 
placement . 

Pleased return the completed green form to me by June 1970 In the 
envelope provided, lhank you again for your help. 



ERIC 
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Community 



Head Start Director 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 



ERjd 



We need your Judgment as to how well the teachers of the classes 
that were tested as comparison groups for the Planned Variation Evaluation 
perform as Head Start teachers. The table below contains the names of the 
teachers and the centers or schools in which they teach. Please rate 
each of them for three time periods: 

Code to Use 

0 = Her performance as of October 1, 1969. 

M = Her perfomance as of Blay 1, 1970. 

P = Tour prediction of how well she will do next year 
(by May 1, 1971) 

For each teacher there should be three entries made on the line 
(use letters 0, H and P) to show how acceptable you Judge her to be as a 
Head Start teacher. You may write the letters over one another, i.e., 

y5 or to show that you ratfe her the same for two time periods. 



Center / School 



Teacher 



USt 
Accept- 
able 



Barely 
Acceptable 



Completely 
Acceptable 



6 



8 



S 



\- 



l_ 

\- 

\. 



12 3 4 



8 



9 
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STANFORD RESEARCH INSTITUTE 



To: 



Head Start Planned Variation Sponsors 



Date: 



July 16, 1970 



From; 



Tor Meeland 



Location: 



Subject: Teacher Goals and Classroom Schedules 



Answering: 



Among the many things covered in the teacher questionnaire iwas an item that 



concerned teacher goals. Attached is a copy of this section, and we ask that 
you please fill it out according to the goals you think would be most appropriate 
for teachers in your model. 

Another item requested teachers to indicate the amount of time now spent in 
vai^ious group sizes compared with the preferred distribu^ ion of time by group 
sizes. Please indicate whether or not this follows your model, and if not, 
please indicate an example that would. 

We also requested a copy of a class schedule for a "typical" day. Attached you 
will find an example of such a class schedule that was copied from a teacher 
questionnaire returned to us. This schedule is from a classroom in your model. 
Would you please indicate on it whether or not it corresponds to tho way you see 
the classes in your program. IT the following code is useful, please use it: 

1. This is Hi very typical schedule for my classes. 

2. Approximately half or more of the activities are consistent with 



3. This schedule, though not the usual one, is to be expected sometimes. 

4. This schedule is not what I would expect in my classes. 

Again, if this schedule does not implement your model, please indicate an example 
that would. 

We are trying to complete the final report by early fall. This information is 
needed for some analyses that should be in process as soon as possible. We 
would much appreciate an early response. 



my model. 
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Appendix C 
FALL 1970 COMMUNICATIONS 



Appendix C 



Date 
♦13 Jul 70 

♦ 7 Aug 70 

*12 Aug 70 

*13 Aug 70 



«24 Aug 70 
1 Sep 70 
1 Sep 70 

« 4 Sep 70 

« 4 Sep 70 
♦ 9 Sep 70 



To 

HSD 
BSD 

HSPV Spons 
HSD 



«21 Aug 70 SCs 



FALL 1970 COMMUNICATIONS 
CONTENTS 

Subject 
Site Coordinators 

Fall Testing Plans 

Fall Testing Activities 

Intensive Studies of Selected 
Students by Dr. Laura Dittnan 
from the Univ. of Md., Child 
Developnent Center 

Sone Elaborations and Review 
of the M. P. Meeting 



Biaet Testers Background Information 



SCs 
SCs 



Use of Invoices 

Class Information Forms 



flSDs (level 

II and III) Ethnic Culture Tests 



SCs 
SCs 



Several Reminders 
Corrections in the Sept. 4 



28 Sep 70 CCD 
8 Oct 70 BSD 



^4 Dec 70 



Progress of the Fall Testiiig 

Reissue of Aug. 7, 1970 memo* 
Fall Testing Plans (with some 
changes) 

Progress Report on the PV 
Evaluation Activities 
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STANFORD RESEARCH INSTITUTE 
To: All Head Start Directora Diie: July 13, 1970 

From: Dr. Jane Stallinge Locatioii: 
Saliiect: Site Coordinators Ai, 



Enclosed are three consultant application foras for the position 
of site coordinator. Will you please ask three people who you feel 
coaply with the attached Job description to complete and return the 
fom to us in the enclosed self-addressed envelopes. 

We would appreciate their returning these foms to us imediately 
since we have to sake our choice of site coordinator from each conmnity 
who will ooae to our training aeeting set for August 17, 18, and 19 
here in Henlo Park. 

Thank you very much. Wa appreciate your ti«e and effort. 
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STANFORD RESEARCH INSTITUTE 



To; 



Head Start Directors 



Au^st 7, 1970 



Subiect: 



From: 



Tor Meeland, Project Leader j //^ 
Head Start Planned Variation Evaluation 
Fall Testing Plans 



Locjtion Menlo Park, Callt' 



Answering: 



INTRODUCTIffUIr 




This Is the first of a series of notes which will describe the details 
of the evaluation activities that Stanford Research Institute will engai;e 
In for the evaluation of Head Stert Planned Variation for 1970-71. First, 
an apology for the length' of this memo, but It Is Important that the context 
and development of SRi's participation In Planned Variation Evaluation be 
specified In considerable detail In order to permit each of you to make 
some sensible scheduling through the year. In the case of the Planned 
Variation communities and their comparisons from last year, SRI Is not a 
stranger; and I hope that the lessons that were learned during the c*ourse 
of the Initial year of evaluation In Head Start will have Its effect.^ on 
the procedures that are outlined for the coming year. For those ccrnunitles 
that are new to Planned Variation and In which we will be making our first 
overtures, I hope you will share with us both the excitement and the 
difficulties of the formal assessment of the effects of Planned Variation on 
the young children. Ad you will see later, we will be Involved with 
over forty commcr itles, and it Is certainly possible for some details of 
organization and planning to get mixed up. If this should happen or If 
you can see difficulties ahead In the activities that we have scheduled, 
please call me (collect) at SRI, phone (415) 326-6200 extension 2682. 

BACKGROUND 

Tb provide a continuity In the Planned Variation evaluation activities 
and to profit from a year of mutual experiences between SRI and the Head 
Start centers, the national office requested SRI to submit a plan for the 
evaluation of 1970-71. This plan was submitted at the end of May and budget 
Ing approved. Shortly thereafter, several changes were recommended both 
by Read Start Washingrton and by the Institute, and a proposal amendment 
was then submitted toward the end of July. The amendment to the evaluation 
proposal reflected a reallgnwnt of prlortles of evaluation activities and 
the addition of new tasks which seem Important for the evaluation of the ' 
Impact of Planned Variation Programs. 

Initial contacts have been made with the Head Start Directors by 
phone In order to identify candidates for the role of Site Coordinator In 
each coamnnity that are reeoMended by each of you and can be approved by 
SRI prior to their participation In a training meeting In Menlo Park August 

Tou will recall that these Initial phone calls also requested Inform 
atioa concerning the composition of the classes and the students and your 
registration schedule in order that an appropriate evaluation design could 
be put in final fom. Prom the Information that you gave us It has been 
possible to generate the testing plan described below. 
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TESTING PLAN 



Since it is economically Imposalble to test every community on every 
aspect of the evaluation plan, a carefully delineated testing schedule 
was devised based on the availability of comparison classes that were 
similar to the Planned Variation classes with respect to age, previous 
Head Start experience, and ethnic composition. 

The evaluation activities have three levels of complexity. Table 1 
shows the locations in irtiich various evaluation activities will occur. 
Each community is identified as a Level I, II, or III according to the 
extensiveness of evaluation activities that will occur during the year. 
On the side of that table is a listing of the evaluation activities involved 
in each of the testing levels and the periods when they will occur. The 
various tests are described in the next section. Some of the locations 
have not been specified to us. 

In the Level II and III projects, a maximum of four Planned Variation 
classes and four comparison classes will be tested. Using an average of 
17 pupils per class, approximately 138 children will be tested given the 
auxiliary battery. A random half of the children in each of these classes 
will get the Binet and the other half the 8-Block Sort. ?he mothers who 
participate in the S-Block Sort will also complete the parent questionnaire. 
The selection procedure will be specified by SRI. 

The Planned Variation communities are part of the SRI test sample for 
the Follow Through evaluation which is being conducted in 105 different 
projects in approximately 90 cities throughout the country. The reason 
for this overlap is to permit the longitudinal study of the effects of 
Planned Variation on the children as they progress form one jrear of Planned 
Variation in Head Start through the third grade in a Fbllow Through setting. 
Hot all children in Planned Variation Head Start will wind up in Follow 
Through, but generally speaking, most of them will. In the case of the 
ccmparison children some will go into regular school systems and some will 
eventually wind up in Follow Through. The longitudinal evaluation that 
SRI is performing for Follow Through will require a careful tracking of 
the children as they progress through the grades in order to determine i^at 
effects, if any, caii be attributed to these various approaches to early 
childhood education. Except for a small part of the auxiliary battery, 
namely the Motor Inhibition tests, all of the test activities listed in 
Table 1 have their counterparts in the complementary evaluations conducted 
for Follow Through. 

Description of the Test Activities 

The following brief descriptions are to provide you with a ready 
reference to the content of the various evaluation activities scheduled 
for the coming year. It is our Intention to provide each Head Start 
Director with a complete set of these tests for examination and comment. 
The request for c omm en ts is a sincere one since it is conceivable that in 
some comannities some activity, or the specific details of an activity, 
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Table 1 

Schedule of Evalusttj^on Activities 
Testing 



Sponsor 


Code 


vDnununxty 


Level 


Nimnieht 


02.02 


Buffalo, N.Y. 


I 




02.04 


Duluth, Minn. 


III 






St. Cloud 


III 




02.05 


Fresno 9 Calif • 


III 




02.09 


Salt Lake City, Utah 


I 




02.13 


Tacomat Wash, 


II 


Tucson 


03.08 


LaFayette, Ga. 


III 






Albany 


III 




03.09 


Lakewood, NeJe 


I 




03.16 


Lincoln, Neb, 


III 


Bank 


05.01 


Boulder, Colo. 


III 


Street 


05.10 


Tuskegee, Ala. 


I 




05.11 


Wilmington, Del. 


II 






DeLaWar 


II 




05.12 


Elmira, N.T. 


III 


Becker k 


07.03 


St. Louis, 111. 


III 


Engle-* 


07.11 


Tupelo, Miss. 


III 


mann 


07.14 


E. Las Vegas, N.M. 


II 


Bus hell 


08.02 


Oraibit Ariz. 


III 






Acoma, N.H. 


III 




08.04 


Portageville, llo» 


III 




08.08 


Mounds, 111. 


II 


IVelkart 


09.02 


Okaloosa, Fla. 


III 






Pensacola 


III 




09.04 


Central Ozarks, Mo. 


I 




09.06 


Greeley, Colo. 


III 




09.10 


Seattle. Wash. 


II 


Gordon 


10.01 


Jacksonville, Fla* 


I 




10.02 


Jonsboro, Ark. 


III 




10.07 


Chattanooga, Tenp. 


III 




10.10 


Bouston. Texas 


II 


BDC 


11.05 


Washington, D.C. 


III 




11.06 


Paterson, N.J. 


II 




11.08 


Jbhnston Co., N.C. 


III 


Pitts- 


12.03 


Lockhaven^ Put* 


III 


burgh 








RBC 


20.01 


bmsas City, Ho. 


III 


HTU 




8t. ThOBAS. V.I. 


III 


Consul* 




Rierto Rico, V.I. 


I 


tants' 




Ifowburg, N.Y. 


I 


Model 




Bellows Falls, Vt. 


I 






Berlin, N.H. 


I 






Billings, Mont. 


I 






Colorado Spgs., Col. 


I 



Level I 

1. Pupil Demograpbic 
(Classroom Infer- 

nut t ion Form) x 

2. Teacher Ratings 

of Children x 

3. Sponsor Ratings 
of Implementation 

4. Head Start Direc- 

tors' Ratings 

5. Teacher Survey 

Level II (in addition to 
• Level I activities) 

6. Classroom (tt>ser** 

vat ions x 

7. Auxiliary Test 
Battery x 

8. Ethnic .Heritage 
Test X 

Level III (in addition 
to Level II 
activities) 

9. Binet Testing x 

10. 8-Blocks Sort 
Testing 

11. Parent Interviews 

12. Intensive Case 
Studies 



Data Collec- 
tion Period 

Fall Sprina 



X 

X 

X 

X 
X 



X 
X 
X 



X 
X 



ERLC 
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could be inconpatible with program goals and if such is the case then 
an elimination, substitution, or an adjustment should be made. Each of 
you can appreciate that it is well nigh impossible to assemble ^ battery 
of tests and procedures that will be completely satisfactory for all 
circumstances in all locations. As awesome as this list of activities 
appears, we have been encouraged by the fact that during 1969-70 relatively 
few incidents of commotion, embarrassment, or difficulty were expressed 
to us. 

The following activities will take place in every community: 

^* Pupil Demography^ Information concerning the characteristics of 
the students in each Planned Variation and comparison class and 
specific information on the^ family composition is obtained through 
the use of a clas^.Kiom information form which will be provided 
later this month in ox*der that the items of interest can be 
completed during the registration period when parents are present 
and can conveniently provide the information requested. Without 
doubt this is the most critical data form that we use, for in it 
is included the descriptive categories of the pupils and the 
families and the identification of the classroom teacherCs). 
These data are fundamental to our record keeping and thus must 
be carefully, completely, and promptly completed. The Site 
Coordinator, whose Job is described below, can be instrumental 
in expediting the completion and the checking of these forms 
prior to their submission to SRI. Detailed instructions for 
completing this form will be provided to you. An up-dating of 
the classroom information form will occur in the Spring to account 
for the fact that some pupils have left the program and/or new 
ones have arrived subsequent to. the Fall test period. It is also 
necessary to delay until the Spring to complete the items on 
attendance records and withdrawal dates. 

2. Teacher Ratings of Children, The California Teacher Rating Scale 
was selected as the instrument by which we will obtain the teachers' 
ratings of the children concerning social, emotional, and cognitive 
development. These ratings are to be obtained for one-half of 
the children in each of the sample classrooms in the fall and 
spring. ^i^B,.^^^ 



3. Sponsor Ratings of Implementation. At the end of the school year, 
appxoximately May, 1971, formal inquiries will be made of the 
sponsors with respect to their porblems and progress related to the 
implementation of their Planned Variation program. In addition, 
each sponsor will be requested to rate his teachers on how well they 
have implemented his program. 

Head Start Director Ratings of Teachers . Complementary to the 
ratings by the sponsors of the degree to which teachers are imple- 
menting the programs, we will request each Head Start Director 
to make ratings of the teachers in Planned Variation and in the 
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comparison classes with respect to how well they are performing; 
as Head Start teachers. Iliis is particularly important to us in 
the case of the comparison classes where no other assessment is 
possible with regard to the skill, quality, and general competence 
of the teachers as purveyors of the Head Start philosophy. 

5. Teacher Survey . This is a teacher questionnaire which is similar 
to the one used in 1969-70 and will be administered to all 
teachers in Planned Variation and in the comparison classes 
during the Spring period of 1971. It takes about an hour to 
complete and will be scheduled by the Site Coordinator. 

For the Level II testing, the first five activities plus the following 
three will be applied in 27 projects. 

6. Classroom Observation . The classroom observation cons its of an 
observer (trained by SRI at a special meeting) who observes for 
two consecutive days three Planned Variation classes and three 
comparison classes in each of the 27 designated communities. 
This observer makes no Judgments, but simply records what tran- 
spires in the interactions among the teachers, aides, and the 
children The scheduling of the Classroom Observations will be 
done by Jhe Site Coordinator. 

7. Auxiliary Test Battery . This is a convenient name for a collection 
of tests which will be given to each pupil. The tests derive 
essentially from the battery that has been administered in Follow 
Through for the past two years, was given in the l969-'70 evaluation, 
and includes the following: 

a. Booklet 3 and 4 . Each test booklet contains three sub-test 
(prepositions, pre-science, pre-math, and alphabet, numerals, 
shape-names) and stems from the original work done in the early 
childhood laboratory at New York University. 

b. Booklet 5 . This is the Pre-School Inventory developed by 
Betty Caldwell at Educational Testing Service originally for 

' application to Head Start children. It has been used 

extensively in the evaluation of Follow Through and in Planned 
Variation last year. 

c. Motor Inhibition . These tests require the child to engage in 
some psycho-motor activity, such as pulling in a car, using a 
tow truck, drawing a line, and walking a narrow board and 
attempt to measure impulsivity control. 

8. Ethnic Heritage Test . This is a new test device developed speci- 
fically to identify the degree to which ethnic identifications 
exist in various sub-groups in our culture. At a minimum, these 
tests will cover Black, and Mexican-American children, and if there 
is time for the development, also American Indians and Puerto Ricans. 
At the present time the plans call for the application of these 
tests only in thos.e communities where there is a sufficient 
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STANFORD RESEARCH INSTITUTE 



To: 



Head Start Directors In the Planned 
Variation Evaluation Levels II and III 



Date: September 4, 1970 



Subject: 



From: 



Ethnic Culture Tests 



Tor Meeland 



Answering: 



Location: 



COPY 



In my note of August 7, 1970, i mentioned that the Auxiliary Battery 
tests could include two tests concerning ethnic culture if you (and your 
PAC chairman) approved. 

For. some time we have been aware of the fact that the test battery 
used in the Planned Variation evaluation was not always completely respons- 
ive to the wide set of objectives and goals contained in all the Planned 
Variation programs. 

The ethnic culture tests (preliminary draft) that you were given by 
our Site Coordinators represent a sincere effort to make an assessment of 
how knowledgable the young Head Start children from Black or Mexican- 
American ancestry are of various aspects of their cultures. These tests 
are but two of a series that are in development; the American Indian and 
Puerto Rican culture tests are yet to be completed. 

We are indebted to the effort and responsiveness of two veteran 
consultants to the Follow Through Evaluation Project conducted by SRI 
since 1968: Dr. Edward Barnes, University of Pittsburgh who developed 
this version of the Children's (!ultural Awareness Scale for Black children 
and Dr. Manuel Ramirez, University of California, Riverside,, who developed 
the Ethnic Identity Questionnaire for children of Mexican-American 
ancestry. 

These tests have had a brief preliminary pre-testing by Dr. Barnes 
and Dr. Ramirez and will go through additional revisions and refinements 
as substantive data are collected. At the moment, however, they represent 
a considerable contribution to the matter of evaluation of the growth and 
development of children, not only Black and Mexican -American, but also 
the many other groups of children who come from diverse backgrounds. 

One may wonde:^ whether or not knowledge of the prowess and reputa-* 
tion of Willie Mays or Malcolm X, or knowledge that there is a festive 
occassion involving a pinata, is indicative of growth in one*s own culture. 
Too, it is a question whetheJr or not non-Black and non-Hexican-American 
children have equal, less, or greater knowledge of these facts and whether 
the level of knowledge changes over time. Television and family conversa- 
tions are two exanples of ways in which children from non-Black and/or 
non -Mexican-American backgrounds could be equally well informed on the 
questions in the tests. The Head Start programs themselves could contri- 
bute to this understanding. 
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number of the group concerned. However, It would be beneficial 
if the test could be given in all of the test classes in the 27 pro- 
jects in Levels II and III regardless of the ethnic distribution of 
the children. A final decision will be made after coordination 
with each Head Start Director. 

For the Level III testing, the first eight activities plus the follow- 
ing four activities will be applied in 19 projects. 

9. Binet Testing with Birch Scoring . The Stanford-Binet intelli- 
gence test with Birch Scoring for response style will be given 
to half of the children in each of the classes being tested. 
The remaining eight will be given the 8-Block Sort test described 
below. The Binet will be given In the Fall and Spring to the 
same children. 

10. 8-Block Sort Testing. This test will be given to the children 
who do not take the Binet and is concerned with the mother-child 
interactioni and requires the presence of the child* s mother 
for the testing to be completed. She will be paid an honorarium 
of $3 for the time she contributes to the activity in the Spring 
of 1971. 

11* Parent Interviews. At the time of the 8-Block Sort testing when 
the mother is present at the Head Start center , she will be asked 
to complete a parent questionnaire with the aide of a parent 
Interviewer who will assist her In reading the Items in the 
event that the mother's reading ability is low and/or to answer 
any quest 5.on8 or resolve confusions. For the completion of this 
parent questionnaire, she will be paid $2 (this is in addition to 
the $3 for the 8-Block Sort test). The intent of these honoraria 
is to help defr?/ any expenses that the mothers might incur in 
arranging for the time for these test activities, i.e., absence 
from work or babysitting fees. 



12. Intensive Case Studies in Individual Children . In 14 locations , 
i.e. 9 one community for each Planned Variation program sponsor , 
an intensive study will be made of two boys and two girls by a 
psychologist from the Early Childhood Laboratory at the University 
of Maryland under contract with Stanford Research Institute. The 
intent of these individual case studies is to help identify those 
areas of development in the children which are not adequately 
covered by the mass testing procedures described abovis. . The 
intensive interviews will concern the child i the parent i and the 
teacher. It is planned that these individual case studies will 
begin Just prior to the start of Head Start classes and continue 
periodically throughout the year. Contact with the Head Start 
Directors will be made by Dr. Laura Dittman, University of Maryland, 
to arrange for the pupils to be studied and the scheduling of the 
interviewers. 
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The items will undoubtedly change in later versions* Criticisms can 
be made that the items reflect a "recent, instant -culture effort," but 
they do reflect a serious, professional effort on the part of Black and 
Mexican-American consultants to offer a beginning to an area of Interest 
that is of differing importance to the Head Start communities involved in 
the Planned Variation evaluation. 

I would like to encourage each Head Start Director to permit the 
Inclusion of these two tests in the Auxiliary Battery. If, after consulta- 
tion with your PAC chairman, you would like these two tests to be given to 
the classes being tested in the Planned Variation Evaluation, will you 
please notify our Site Coordinator of your wishes. The Site Coordinator 
will: 1) inform us of your desire and 2) include the tests in the Auxiliary 
Battery. 



C-25 



..137 



In order to give some appreciation of the scope of these evaluation 
activities, the following numbers are provided: in the Fall, approxi- 
mately 5,000 pupils will have some assessment made of them; teacher ratings 
will be done on 2,500; Sponsor and Head Start Director ratings of teachers 
will number approximately 250 and 350 respectively; classroom observations 
will be made in 162 classes; the auxiliary test battery and the ethnic 
heritage test will be given to about 3,500 children; the Binet and 8- 
Block (also parent interviews) will be administered to about 1,200 pupils; 
and the intensive case studies will number 56. It will be a busy year! 

It is important that the details of the evaluation activities be 
shared with each Head Start Director, but certainly it can be appreciated 
that disclosure of the content, form, and intent of the various test' 
activities to the pupils and/or teachers would severely compromise any 
test results. We encourage your sharing of these plans and their details 
with your PAC chairman in order to obtain the best possible guidance that 
you can convey to us concerning potential difficulties of implementation. 
Please care for the test materials we send you; if they become available 
inadvertantly to teachers or pupils, then any test results we obtain 
could be questionable. 

TESTER ORGANIZATION 

Profiting from our experiences last year and attempting to respond 
to various criticisms and recommendations made by the Head Start Directors 
and our own staff at home and in the field, some changes in the tester 
organization have been made in order to provide a more controlled and 
economical implement at ipn of the test activities. The test organization 
is built around the locally employed Site Coordinator whose required 
characteristics and background have already been conveyed to you. Your 
recommendations of potential Site Coordinators have been reviewed and 
decisions made based upon their credentials. The Site Coordinators are 
being informed by telephone of their appointments with follow-up confirm- 
ation in writing along with the necessary administrative details of pay 
procedures and forms. Air tickets are being sent to all who must fly in to 
the training meeting in Menlo Park, California, August 17-19, 1970. 

The Site Coordinators will be responsible for the implementation of 
the testing activities in their communities and in coordination with the 
Head Start Directors arrange for the scheduling of the testing in the 
classes. The presence of a lodally based Site Coordinator should simplify 
the communications between SRI and the projects and reduce the burden 
of the evaluation activities on the directors and staff. 

With guidance from SRI and approval by the director, the Site Coordina- 
tor will select the testers needed for the auxiliary battery, parent 
interviews, classroom observations, 8-Block "^Sort test, and Binets and 
coordinate their participation in training sessions. In the case of the 
auxiliary battery tester and parent interviewer, the Site Coordinator will 
do the training. The other testers will be trained by SRI staff at 
various central locations. 
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To: Tor Meeland 

Head Start Planned Variation Evaluation Project 
SRI 

Menlo Park, California 



Approval is given for th^ administration of the following 
tests during the spring 1971 testing period: 

Yes ( ) No ( ) Children*s Cultural Awareness Scale 

(Black Culture) 

Yes ( ) No ( ) Ethnic Identity Questionnaire 

(Mexican-American Culture) 

Additional comments: 



Signed 



Head Start Director 



Date 



Community 



1^ 



In each oommunity the number of testers needed will vary according to 
the number of children to be tested and range as follows: 



Number of testers needed 



Tester Type 



Level II 
Testing 



Level III 
Testing 



Auxiliary Battery Tester 
Parent Interviewer 



2 



4 



2-4 



1 



1 



Binet Tester 



1 - 



2 



8-Block Sort Tester 



1 - 



2 



Class Observer 



1 



1 



^ For all testing activities, the Site Coordinator is responsible 
for assuring that all data forms are properly completed and the pre- 
scribed procedures carried out. All test materials are to be coordinated 
and checked by then prior to shipping to SRI. 

The overall supervision of the performance of the Site Coordinators 
will be done by SRI staff based at Henlo Park. A team of eight Field 
Supervisors will be used to oversee and coordinate the specific activities 
of each of the Site Coordinators. This layer of supervision serves two 
functions: first, is the overseeing of the activities in the evaluation 
program and the performance of the Site Coordinators and second, it 
provides the Institute with the means for personal representation at 
each of the Bead Start Planned Variation communities. 

TRAINING SESSIONS . 

The several training sessions that are necessary for the initiation of 
the Fall evaluation activities are as follows: 

a. The Site Coordinators training session will be held at Menlo Park, 
California on the SRI campus August 17 through 19 at which time 

a complete orientation will be provided on the evaluation plan, 
the workings the SRI organization, and the details of the testing 
procedures that are to be followed. This coordination and training 
meeting is of critical importance for the success of the Planned 
Variation evaluation. Upon their return to their communities, 
the Site Coordinators will have to immediately recruit the auxi- 
liary battery testers, Binet testers, and the classroom observers 
where appropriate, and also coordinate with each Head Start 
Director the details of the Fall testing program. During the week 
prior to the beginning of testing, the Site Coordinators will 
have to train the auxiliary testers in their specific tasks. The 
training of the auxiliary battery testers will require approximately 
teo days and will involve actual practice with young children. 

b. The training and coordination session for the Binet testers will 

be conducted by SRI staff at two central locations. The Assignment 
of th^ Binet tester to either of the training sessions is dictated 
by economies of transportation, generally. Even though the Binet 
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STANFORD RESEARCH INSTITUTE 



Site Coordinators 



Date; 



September 4, 1970 



From: 



Tor Heeland 



Location: 



Subject: 



Several Reminders 



Answering: 



1. Class Observers (Levels II and III only) 

a. In order to arrange for the hotel reservations and airline pre- 
ticket ingi it is most important to receive the names of the observers you 
have chosen. Enclosed is an application form (plus a spare) that the 
class observer must complete and be sent to SRI as soon as possible. 

b. In order to prepare mailing labels and to get ready for the 
processing of the class observation data» we need a list of the four 
classroom teachers in Planned Variation and the four comparison teachers 
of the classes to be tested (of course, if the comparison classes are in 

an off-site location you will only be able to send the names of the Planned 
Variation teachers or the comparison teachers.) If at all possible, 
please call in the names of these teachers by Wednesday, September 10, 1970 » 
to Patsy Reiliy extension 2682 or Kay Fisher extension 4553. The phone 
number is (415) 326-6200» collect. If the classes to be tested are still 
uncertain (and this is true in some locations) see part 3 below. 

2. Classes to be Observed (Levels II and III only) 

At the meeting in Menlo Part we had planned on observing in three of 
the four classes in Planned Variation and three of the four comparison 
classes. This is now changed. All four Planned Variation classes and all 
four comparison classes should be observed unless prior agreements that 
you made with the observers can not be changed. 

Thus, each observer is expected to observe eight classes (four Planned 
Variation and four comparison) for two days each plus an initial practice 
day for a total of 17 days of observation. In communities where the 
comparison classes are off -site, the number of classes to be observed will 
be nine (four claeses for two days each plus a practice class). All off- 
site communities ( Albany » Georgia^ St. Cloud, Minnesota, Acoma, New Mexico, 
Pensacola, Florida^ and Miff lenburg, Pennsylvania) will also need nine days 
of observations (four classes for two days each plus a practice day). 

3. Classes to be Tested (Levels II and III only) 

The Lists of Classes to be Tested that you got at SRI was based on the 
best information given to us three weeks earlier. In some locations, the 
centers or classes have changed. In a few instances I have talked with 
you or the HeadSstart Director about the changes in classes and what changes 
should be made in the classes that should be tested. If your list of classes 
to be tested is out of date due to local changes, please call me so that we 
can coordinate our records. 
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testers cone highly qualified with respect to the administration of 
the Blnet test, it is still necessary for the Site Coordinator to 
check their data forms to make sure that certain administrative 
procedures are followed and that the data forms are coiq>lete. The 
test results of the Blnet testers. Just as in the case of the aux- 
iliary battery testers/ will be submitted to SRI by the Site 
Coordinators • 

c. Class observer training. The training sessions for the classroom 
observers will be held in two locations during September; the 
locations and dates will be determined shortly. 

The class observers will be required to do some home study in 
preparation for the training session so that they arrive at the 
training meeting with various codes already committed to memory. 
The training session itself will last for five days, part of 
which time will be devoted to practice in Head Start classes. 
The sQheduling of the classes to be observed will be coordinated 
by the Site Coordinator in conjunction with each Head Start 
Director. 

d. 8-*Block Sort training sessions will be conducted hy SRI staff in 
April 1971 at locations to be determined later. 

PAYMENT OF TESTERS 

To provide a more direct and responsive means for processing the pay- 
ments to the testers, all testing will be done on piece work which will be 
paid directly by SRI. 

From the past year of experience with testing costs , rates have been 
established for each category of tests. Thus for the fall testing the 
Auxiliary Battery testers will be paid $2.20 for each child tested. A 
stipend of $30.00 will be paid to the Auxiliary Battery tester for success- 
ful completion of a two day training session to be conducted 1^ the Site 
Coordinator. 

The pay schedules for the class observers , parent Interviewers, and 
8-Block Sort testers will be provided to the Site Coordinators. 

TESTING SCHEDULE 

The pupil testing should be coiq)leted in a three-*weidk period. The 
tester staffing is based on twelve days of testing; the three additional 
days are for scheduling problems, should they occur. Testing will begin 
at each crenter during the second week of class , except in locations where 
dlass started prior to August 28. The earliest date of testing is Septem- 
ber 8. Test dates for each community are shown in table 2 along with the 
date of the start of classes. If the class starting date is incorrect, 
please noti:^ me in order that the testing period can be changed. 
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4. Order of Testing of the Pupils (Level III only) 

You will^Aptice in the random permutations sent to you, that Klara Evans 
has reminded you which permutation block you should start with. 

Several of you have raised the question as to the order of testing 
for the Auxiliary Battery and the Binet tests, i.e., who goes first? 

If the Binet tester and Auxiliary Battery tester both work in the 
same class, I would suggest that the Binet tester start at the top of the 
list and the Auxiliary Battery tester begin with the second half of the 
children. Some conflict will probably happen as the Binet tester gets 
to the end of his list of children (the first half of the class), and it 
will need some careful scheduling to permit each tester to work efficiently. 
(In the case of a couple of locations that I have talked with, specific 
guidance was given to solve the particular problems.) 

5. Stipends for Teachers (all levels) 

In view of the efforts made by the teachers in completing the ratings 
of the children (yellow forms) a stipend of $10 will be given to the teacher 
upon completion of the ratings and the Classroom Information Forms. If 
there is more than one teacher involvcid with a class, please have the 
ratings completed by the head teacher. The $10 stipend will be paid to 
this head teacher who can distribute the money as she wishes. 

The ratings of pupils by teachers should be done in all Planned Variation 
classes but only in the four comparison classes that are tested. All children 
in the class should be ral^d, not Just half of them. The $10 should ease the strain. 

6. Classroom Information Forms (all levels) 

Classroom Information Forms must be completed for all Planned Variation 
classes and the four comparison classes. This is most important in order 
for us to be able to describe the characteristics of all the children who 
participate in Planned Variation. - 

7. Ethnic Heritage Tests (Levels II and III only) 

The printing has been completed for the tests that are related to 
various cultural aspects of two groups: Blacks and Mexican-Americans. 
As of this time, similar tests for American Indian and Puerto Rican children 
are not ready. In my memo of August 7, 1970, to the Head Start Directors, 
I asked that the Director, in consultation with the Policy Advisory Committee 
(PAC) chairman, decide If these two tests are appropriate to the local 
program and to give approval for their inclusion in the auxiliary test 
battery. 

It Is most important that you discuss these tests with the Director 
and to send me a statement that she agrees to the administration of the 
tests to the children In the four Planned Variation and/or comparison . 
'classes that are tested. 

Separately, I have sent a letter to each Director explaining the 
Intent and possible usefulness of these tests and have asked that she give 
her approval for their use in some or all classes (copy attached). This 
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Fall 1970 Test Dates 

Pupil Class 









Testing 


First 


Testing 


Observation 


Sponsor 


Code* 


Community 


Level 


Day of Class 


Start d 


Starts 


Niflinlcnt 


02 •02 


BuzzalOi N*Y* 


I 


Sept. 14 












02.04 


Duluth, Hinn. 


III 


Sept. 14 


Sept. 


21 


Oct. 


19 






St • Cloud 


III 


Sept. 14 


Sept. 


21 


Oct . 






02 .05 




TTT 
XX X 


Depx . X4 


Sept. 


21 


VICX . 


1 Q 

X9 




02.09 


Salt Lake City, Utah 


I 


Sept. 23 












02.13 


Tacoma, Wash. 


II 


Sept. 2 


Sept. 


14 


UCX . 


1 0 


Tucson 


03.08 


LaFayettSi Ga. 


III 


Aug. 31 


Sept. 


8 


Oct. 


5 






Albany 


III 


Continuous 


Sept. 


8 


Oct. 


5 




03.09 


Lakewood, N.J* 


I 


Oct. 12 














Xiincoxn 1 rieo • 


TTT 
ill 


Sept . 8 


Sept. 


14 


lICX . 


1 0 


Bank 


05.01 


Boulder 1 Colo. 


III 


Oct. 5 


Oct. 12 


Nov. 


9 


Street 


05.10 


Tuskegee, Ala. 


I 


Oct. 1 














wixmingtoni uex. 


T T 
II 


July 15 


Sept. 


14 


Oct . 


12 






DeLaWar 


II 


Sept. 21 


Sept. 


28 


Oct . 


26 




05.12 


Elmira, N.Y. 


III 


Continuous 




Q 


Oct. 


5 




/\7 HQ 
Uf aUO 


IS. &>t . XOUlSy IXX. 


III 


Sept . 14 


Sept . 


21 


Oct. 


19 


Engle** 


07.11 


Tupelo, Miss. 


III 


Sept. 8 


Sept . 


14 


Oct. 


12 


mann 


07.14 


E. Las Vegas, N.M. 


II 


Sept. 14 


Sept . 


21 


Oct . 


19 


Bushell 


08.02 


Oraibl, Ariz. 


III 


Aug. 27 


Sept. 


8 


Oct. 


5 






Acoma, N. li. 


III 


Aug. 27* 


Sept. 


8 


Oct. 


5 




UO • U4 


w> r t age vixxe , ho . 


TTT 
III 


vicx. o 


Sept. 


8 


Oct. 


5 




OR OR 


HOuuQS , iXX • 


TT 
II 


Sept . 2 


Sept. 


14 


OCX . 


12 


Weikart 


09.02 


C^aloosa, Fla. 


III 


Sept. 8 


Sept. 


14 


Oct. 


12 






Pensacola 


III 


Aug. 31 


Sept . 


8 


Oct. 


S 




09.04 


WUbX^SX VAClf K0 1 MO. 


T 

X 


AUg . OX 














VAWXfyy 1 vuxu . 


TTT 
XXX 


oep X . X4 


Sept. 


21 


Oct. 


19 




09.10 


Seattle, Wash. 


II 


Sept. 15 


Sept. 


21 


Oct. 


19 




10 01 

XV • ux 


«i»dwoon vxxxo , r x a . 


T 

X • 


find of j^on*^ 












10.02 


Jonesboro, Ark. 


III 


Sept. 8 


Sept. 


14 


Oct. 


12 




10.07 


Chattanooga, Tenn. 


III 


Sept. 8 


Sept. 


14 


UCX . 


1 9 
X^ 




10.10 


Houston 9 Texas 


II 


Sept. 2 


Sept. 


14 


Oct. 


12 


BDC 


11.05 


Washington, D.C. 


III 


Sept. 8 


Sept. 


14 


Oct. 


12 




11.06 


Paterson, N.J. 


II 


Sept. 14 


Sept. 


21 


Oct. 


19 




11.08 


Johnston Co., N.C. 


III 


Sept. 8 


Sept. 


14 


Oct. 


12 


Pitts- 


12.03 


Lockhaven, Pa. 


III 


Aug . 31 


Sept. 


8 


Oct. 


S 


burgh 
















RBC 


20.01 


Kansas City 9 Mo. 


III 


Sept. 21 


Sept. 


28 


Oct. 


26 



HYU 



St. Thomas, V.I. Ill 

?ttv 



approval (or disapproval) Is to be given to you for submission to me* 



In the event that some children have already been given the Auxiliary 
Battery before approval Is granted, I suggest that only the remaining children 
be given the tests* It would be too expensive to have the Auxiliary Battery 
Testers go back and pick up children already given the ^^sts* Payment to 
the Auxiliary Battery testers will remain the same ($2.20 per child) 
whether or not the ethnic culture tests are given* 

8* Administration of the Children's Cultural Awareness Scale (Levels II 



9. Administration of Ethnic Identity Questionnaire (Levels II and III) 

Instructions are shown on the test forms* If the tester cannot 
pronounce the Spanish words for Items 1 and 3, note this In your log and 
Instruct the tester to omit these Items. 

10. A reminder of observer training locations* (Note that the Rochester 
meeting Is shifted to New York City): 

September 14 - 18 New York City at the Commodore Hotel 

September 21 - 25 Atlanta at the Atlanta Blltmore 

September 28 - October 2 Denver at the Sheraton Inn 

Meetings start at 8:30 Monday morning* The session will end 3p«m* 
Friday. 



and III) 

The cost of providing tapes and tape recorders is so great that we 
must drop Item 13 from the test at this time* 
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Table 2 (Gon*t*) 



Consul- 
tants ' 
Model 



Puerto Rico I V.I. 
Newburg, N.Y. 
Bellows Falls, Yt* 
Berlin, N.H. 
Billings, Mont* 
Colorado Springs, Ool« 



♦Estimate 



STANFORD RESEARCH INSTITUTE 



To: 



Site Coordinators 



Date: 



September 9, 1970 



From: 



Tor Meeland 
Corrections In the September 4 Memo 




Location: 



Subject: 



Answering: 



Please be advised o£ the following corrections In the 
September 4 memorandum "Several Reminders": 

1. On page 2 section 5: The second sentence o£ the 
second paragraph should read^ "All children In the class should 
be rated y not Just hal£ of them." 

2. On page 3: "Payment to the Auxiliary Battery testers 
will remain the same ( $2,20 per child)," The point to be made 
Is that there will be no reduction In price 1£ the culture 
test Is not given. 



The period for the class observations is also shown in table 2. It is 
planned that this period start one week after the testing (or four weeks 
after the start of testing). 

FINALLY 

The SRI Head Start project staff is looking forward to a year of 
excitement and certainly lots of work. The extent to which sensible state- 
ments can finally be made about the effect, if any, of the considerable 
effort that has been put into Planned Variation rests to a great degree on 
the quality of the data collected. We will make every possible effort to 
provide proper and adequate guidance for the testing procedures and control 
of the testing conditions. Your help is earnestly requested to help us 
achieve these goals. 

If you have any questions, please call me or Dr. Jane Stallings (collect) 
at (415) 326-6200. 



Information copies to: 

Dr. Lois-ellin Data (4) 
Planned Variation Sponsors (2) 
Head Start Regional Directors (2) 
Joint Fellows 
Project Staff 

Head Start General Consultants 
Field Supervisors 
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MEMO 



SUBJECT 



FROM: 



TO; 




Head Start Directors 




CC: 



OATE 



LOCATION: 



12/24/70 



1. Fall Testing 

As you can imagine, the fall testing for the Planned Variation Evalu- 
ation ran the gamut from easy, simple, well coordiniaited work to situations 
where there was a delay of Head Start openings and consequent tester 
scheduling delays, and mixups were inevitable or our shipping of test 
materials got mixed up. Except for a very few logistical difficulties 
(where each was a personal defeat), the extensive testing activities 
were done with relatively little difficulty from the point of view of 
the project team. From your correspondence, phone calls, and from reports 
from our site coordinators, we are aware of many problems, some real and 
some hopefully imaginary, that arose during the fall testing. 

I would like to share the problems (as I see them) that arose in 
order that ways might be prescribed to avoid the difficulties the next 
time. From all the information I have, there is no single problem that 
pertains to all of you. Instead, there are several issues which affected 
one or more communities which should be listed and alternatives proposed 
in order that subsequent evaluation activities can be carried out effec- 
tively with minimum interference to the programs being applied to the 
children. 

Probably the most significant item for this fall was the effort put 
forward by each Head Start Director to help in the selection of the Site 
Coordinators who were to relieve the directors of much, if not all, of 
the evaluation- activities. This was a most significant step because it 
provided SRI with a qualified community member who was in tune with the 
program and could directly and thoroughly reflect the needs of the 
community with respect to the work we are charged to do by the Office 
of Child Development, HEW. 

You will recall that in the early fall I presented the reasons why 
it was desirable, from our view, for the children to take an ethnic 
heritage test to give us early information on various aspects of the 
Black and Mexican-'Amerlcan cultures. About half of the communities 
(19 of 43) opted to permit this testing. The number that agreed to the 
testing is not the important point, rather it was the way in which the 
testing was presented that was critical. I offered various reasons why 
it was useful to participate, and asked that you and your PAC chairman 
make the final decision as to whether the teats should be given in your 
community. The reasons for rejection were either the tests were "not 
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STANFORD RESEARCH INSTITUTE 



To: 



Itoad Start Planned Variation Sponsors 



Dite: August 12, 1970 



From: 



Tdr Ueelandt Project Leader ^f^"^ 
Head Start Planned Variation Evaluation 
Fall Testing Activities 




Location: 



Subject: 



Answering: 



Att :hed is a copy of the coordination memo which has been sent to 
all Itoad if^tart Directors in preparation for the various testing activities 
to be carried out this fall. 

Based on our experiences last spring and with some acknowledgement of 
the budgetary restrictions for the year, we are using locally based Site 
Coordinators for each project in the Planned Variation evaluation (plus 
an additional Site Coordinator for off-site comparison locations). These 
Site Coordinators will be the SRI representatives throughout the year 
and will coordinate all of our test activities, including the training 
of the auxiliary battery testers and the parent interviewers. As indicated 
in the attached memo, the training of the S-Block Sort testers and the 
classroom observers will be carried out by SRI staff. 

Next week we will send you a list showing the names, addresses, and 
phone numbers of each Site Coordinator so that you will know who to talk 
to if you have any scheduling problems in any given community. We hope 
the Site Coordinators will keep abreast of your own test activities and 
will keep us informed of them so that we can minimize or eliminate any 
conflict of scheduling. Should a problem arisSi I would suggest that you 
contact the Site Coordinator first and if you get no satisfaction, of 
course call me at Henlo Park (phone: (415) 326-6200 extension 2682) or 
Dr. Jane Stallings (extension 3564). 

I don*t know whether or not Head Start Washington has alerted you to 
a Head Start Planned Variation sponsors* conference in Henlo Park in the 
fall. The initia'c date was to be October 19-21. Will you please reserve 
this period on yorir calendar and also the period of November 2-4, for the 
second date is now becoming more attractive to us in terms of the amount 
of preparation that is required of us for a successful conference. Agendas 
and lists of conferees will be sent to all of you so yoM can identify friend 
and foe. The general intent of the meeting is to critically review the 
workings and the outcomes of the 1969-70 evaluation, appraise a set of 
presentations (or position papers) concerning candidate measurement and 
schemes for the assessment of sponsor/program objectives. We plan to provide 
you, prior to the meeting, with our Final Repo3:lj3f 1969-70 and the additional 
papers concerning objectives and assessment devices. This early alert is 
to give you time to consider whether or not you think you would like to 
make jomt own presentations of objectives in your prop^ram and means for 
assessment -""^v-^ 



cc L. Datta 

J. Stallings 
T. Heeland 



Memo to Head Start Directors 



December 24, 1970 



particularly germane to the community program" or "the tests were too 
hard and should be given In the spring/* Also, not every community 
where the children were predominantly Black opted to Include the tests 
on Black culture. The Important point was that the Inclusion of a test 
was done In Joint counsel with a community. Certainly a national evalu- 
ation needs to have a common core of tests In order to have a reasonable 
basis for comparative and In-depth analytic study, but still, I think, 
a way has been found to get substantive guidance and counsel from the 
communities with respect to the testing of the children and adults 
Involved In the PV program. 

The field organization has grown over last year to accommodate the 
new projects In PV. As near us I can determine, we now have & family 
of 41 Site Coordinators, 44 Blnet testers, 68 auxiliary* battery testers, 
and 38 class observers. A sizeable group! Except for Portagevllle, 
which Is an old friend In the Head Start and also the Follow Through 
Evaluation, the project staff visited every Level II and III testing 
site for the fall testing. These visits by Cindy Soliza, Klara Evans, 
Becky Simons, Ann Smith, Phil Baker, and Pat Gillespie were most Impor- 
tant to us because they provided a means for direct contact with you and 
the tei^tlng circumstances. 

In a couple of Instarices, our testing/observe' personnel didn't 
completely fit Into the Head Start milieu and with your concurrence 
we will make some changest Also, In two locations It was reported that 
the $10 stipend to the teachers for their efforts In completing the 
California Preschool Social Competency Scale (Teacher Ratings) was 
Insufficient renumeratlon for the time and effort expended. The rating 
of 15-20 children should have taken about an hour. This, In addition 
to the cooperation In completing the classroom Infomatlon form seemed 
to be reasonably recompensed. We were fortunate to get this stipend; 
it will be given again In the spring for a repeat on the California 
Preschool Social Competency Scale. 

Although testing was to be completed during the second to the fourth 
weeks of class, some scheduling difficulties occurred which required 
testing to overflow this period* This was also the experience last year, 
bit the spring testing, because there Is time for coordinating and 
scheduling, should be done within the three-week period tentatively 
scheduled for Hay. The exact dates will be determined when we know the 
scheduled last day of class for each community. (T6 help In our planning, 
would you please complete the enclosed form and return It to me before 
January 15, 1971. An envelope Is provided for your convenience.) Class 
observations will occur prior to the pupil testing, i.e. April 1971, 
tentatively. 

The attached table summarizes the number of children tested in your 
project and also shows the number of tests that were sufficiently com- 
plete to be entered^ into the data bank. Instances of missing data were 




STANFORD RESEARCH INSTITUTE 
A DRAFT FOR REVXEW BY DR. LAURA DIUMAN 

Head Start Directors Date: August 13, 1970 



From: T« Meeland 




Location: 



Subject: Intensive Studies of Selected Answering: 
Students by Dr. Laura Dltman from 
the University of Maryland Child Dev. Center 



One important adjunct to the Planned Variation evaluation conducted 
by Stanford Research Institute is the intensive study of selected children 
in various communities by the staff of the University of Maryland Child 
Development Laboratory which is to be supervised by Dr. Laura Ditman. 
For Dr. Dltman to successfully complete her intensive study of selected 
children it is necessary for her to identify with, in conjunction with 
the Head Start Director, the children to be intensively studied over the 
year. and to make the initial interviews prior to the start of the Planned 
Variation programs, if possible, and to continue at periodic intervals 
throughout the year. This intensive study will cover not only the child, 
but his teacher and his parents and qualified interviewers from the 
University of Maryland will accomplish this work. 

The procedure for the selection of the four children .(two boys and 
two girls) in each location will be specified by Dr. Ditman* s field 
representative (name) who will contact you by phone to arrange a mutually 
convenient time for the selection of the children and the initial interviews. 

Based on the preliminary work that Dr. Ditman did last year in eight 
communities in Head Start Planned Variation and the work for this year, 
it is hoped that those areas which are not adequately covered by the mass 
testing by SRI can be identified so that for the third year of the Planned 
Variation evaluation modifications in the test battery can be made in order 
to more sensibly and more adequately cover those aspects of the children's 
development that seem pertinent to the objectives and the intent of the 
Planned Variation programs. 



The report by Dr. Ditman and her colleague has been received and it 
is my intention to convey her preliminary findings to you so that you are 
aware of the kinds of things that can evolve from this intensive study of 
specific children (Note: Laura: perhaps you want to strike this sentence) 

If you can anticipate any scheduling activities resulting from the 
efforts of the intensive child study people, would you please call me at 
(415) 326-3200 extension 2682 so that the intrusion can be minimized. 



C-lMo-f 



Memo to Head Start Directors 



December 24 » 1970 



due to test administration troubles (carefully documented by the testers 
in their test logs, this reflected an exemplary self criticism on the 
part of the testers that added substantively to the quality of the data 
we process) or refusals of children to take or complete the tests (these 
children typically will be willing to take the tests in the spring). If 
the numbers entered do not agree with your records or recollect ion , 
please tell me how they differ. There could be an error in our tallies 
or in the transcription to this table. 

2. Spring Testing 

The test program for the spring will be detailed later, and will 
include a Teacher Questionnaire, a mother-child interaction test, and a 
Parent Questionnaire along with the tests given this past fall. The 
children who did not take the Binet will participate in the mother- 
child test and these mothers will complete the Parent Questionnaire. 
Again, we will submit the teacher and parent questionnaires to you for 
early review and comment. I hope you will examine the questionnaires 
very critically and offer your suggestions to us quickly so that we 
can respond sensibly to your suggestions. During the spring we will 
also request each Head Start Director to rate the teachers on how well 
they perform in the context of Head Start. These ratings are most 
important to the implementation evaluation. 

The demographic descriptions of the children and their families have 
been critical to the analysis of last year's data and will be extensively 
used this year. In spite of the effort made this fall, we are still 
faced with incomplete data for some children in four projects. In these 
cases, the needed information is shown with this memo and I would appre- 
ciate every effort you make to get the forms completed. 

3. 1969-70 Report 

Our report of the Planned Variation program of 1969-70 was provided 
in draft form to OCD and to the sponsors and consultants to Head Start 
in October. Many criticisms and suggestions resulted in further analyses 
and rewriting; the revised report should be at OCD after the new year 
and will be made available according to the plans of OCD. The findings 
are substantive and exciting and more than compensate for the huge effort 
that you supported last year; the children should benefit from what we 
were able to appraise. 

4. Summary 

This note has tried to cover several topics briefly in the belief 
that a recap such as this could serve as a reminder of what happened in 
the ;f all testing, our concerns related to a few problems, and an early 
alert of the spring activities. More importantly, however, is the oppor- 
tunity to thank each of you for your patience and forebearance in the 
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STANFORD RESEARCH INSTITUTE 
To: Site Coordinators Date: August 21^ 1970 



From: Tor Meeland^J^^y Location: 

Subject: Some Elaborations and Review of Answering: 
the Menlo Park Meeting 



!• A Calendar of events is shown on the next page for locations that 
start testing September 8. For plans ^ere testing starts later, 
you must obviously slip some of the dates; but the sequence is 
still appropriate. 

2. A list of Auxiliary Battery Testers that were used last year is shown 
next. Please do not hire any tester ^ere the notation "no*' is 
shown. 

3. By 5 p.m. (PDT) Monday, August 24, the Site Coordinators in Level III 
communities should have called SRI about Binet Testers. (Kay Fisher 
(415) 326-6200 Extension 4553) Binet testers will receive a $60 
stipend for training. 

4. Ethnic Heritage Tests . Printing will not be completed in time to 
include the final forms and instructions in the Test Kits for Level II 
and III, or in packages for Level I locations. Also, remember that 
these tests are not to bsvgiven until we have coordinated with the 
Head Start Directors. 



5. Training Meetings are scheduled as follows: 

a. Binet Testers: August 31 - Atlanta, Geprgia 

September 1 - Chicago, Illinois 

b. Class Observers: September 14-18 - Rochester, New York " 

September 21-25 - Atlanta, Georgia 
September 28-October 1 - Denver, Colorado 

Trainees are to arrive the evening before the first training day and 

leave by 5 p.m. the last day of a session. 

6. Class Observers ' names and application forms (yellow) must be sent to us in 
order to make airline reservations and shipping labels for class 
observation forms which will be mailed from the National Computer 
Service Company (NCS) in Minneapolis, Minnesota. Class Observers 

will receive a $50 stipend upon completion of training. 



7. Classes to be tested . Attached is a list of all the Planned Variation 
classes and the comparison classes available (according to our records). 
The circled classes are the ones to be tested. Please disregard the 
list you received Wednesday, August 19, at SRI if it is different 
from the attached list. The order in which the Planned Variation and 
coiq)arison groups should be tested is shown by the circled letter 
A or B. Whichever is circled should be tested first in your community. 
The order does not apply where the comparison classes are off-site 



Memo to Head Start Directors 



December 24, 1970 



ivork we must do and to ask each of you to share your criticisms and sug- 
gestions about these evaluation activities in order to make the spring 
work simpler, more direct and responsive to the long-term needs of the 
centers and the children. Finally, the project staff here at SRI extend 
very heartfelt seasons greetings to each of you. 



Information copies to: 

OCDf Head StCTt 
Site Coordinators 
Head Start Consultants 
Sponsors 

Head Start Regional Directors 
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Reference Calendar for Locations Where 
Testing is to Begin September 8, 1970 



August 17-19 
20 

Monday August 24 



Wednesday August 26 
Friday August 28 
Monday August 31 



Continuing through 
Friday September 4 



Tuesday September 8 



Friday September 25 



4 Meeting at SRI for Site Coordinators 
0 Return home 

• M^et with Head Start Director - describe and coordinate 

your needs and plans. 
0 Hire Auxiliary Battery Testers and Class Observers. 
(When found, they mu^t complete application forms.) 

• Test Kits shipped from SRI 

• Receive Test Kits 

0 Distribute Class Information Forms and Instructions 
to all Planned Variation (sponsored) classes and 
comparison classes. 

0 Noon: If test kits have not arrived, call Cleet Coble 
(415) 326-6200 Extension 2407. 



§ Instruct Auxiliary Battery Testers on procedures 
Have them practice on children (who are not going 
to be tested) 

0 Check on coordination of testing with teachers. 

0 Encourage the completion of Class Information Forms. 

0 Check on testing room arrangements. 

• Testing begins. Check each tester on her first day. 

This may require staggering the start of one or two 
testers. 

• Testing complieted; return Test Kits to SRI. 
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RECAP OF FALL '70 TESTING ACTIVITIES IN 



P.V, Classes 
Tested Not Tested 

Number of Classes 

Number of pupils for whom information 
is complete: 

a. Classroom Information Form 

b. California Preschool Social 
Competency Scale 

Number of tests completed: 

a. Auxiliary Battery 

b. Binets^ 

c. Children's Cultural Awareness Scale ^^^^^^^ 
and/or Ethnic Identity Questionnaire 



^ Should be half of each class in Level III sites. 
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(Albany, Georgia; St. Cloudi Minnesota; Acomai New Mexico; Pensacola, 
Florida* ) 

Please check with the Head Start Director to be sure that the classes 
listed are still correct* Also, if a Planned Variation class is 

funded by the sponsor , it should be replaced by a class that is not 
In some locations, it is possible that a sponsor* s program is supported 
in one or loore classes by local or other funds* 

8. Application forms for Auxiliary Battery Testers, Olass Observers and 
Binet Tester? are enclosed. 

Auxiliary Battery Tester must fill out the yellow form. You 

sign it and return it to me. 
Binet Testers must fill out the green form and get reference 

sheet completed by reference (if not already done 

last year). 

Class Observers must complete yellow form, you sign and return it to me. 

9. Expense and pay procedures . New invoice forms are at the printers 
^ and will be sent later along with detailed instructions. These 

invoice forms are to be used by you, the Auxiliary Battery Testers, 
Class Observers, Binet* Testers and anyone else that tests during 
the year. You must check all of them prior to sending them to SRI. 

10. It was a pleasure to have you visit SRI for the training session. I 
hope the many details have now fallen into line, but if you feel any 
gap still exists, simply call us. This memo is very brief, but the 
movers are packing us up to shift the staff to the other side of the 
Middlefield building. My desk goes in a few minutes. 

11. A last item. Enclosed is a copy of the Planned Variation program 
in some of your communities. Please remember that as part of the 
evaluation effort you must take every precaution not to participate 
in the programs. Remind all your testers that as evaluation team 
members they must avoid acting as change agents. 
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STANFORD RESEARCH INSTITUTE 



»«= Ttar Heeland D«ie: 
SRI 

Henlo Park, California 94025 
From: , Head Start Director 



city 



Answcfing: 



le Our Head Start classes will end > , 1971. 

south date * 

2. The total number of P.V. classes (tested plus not tested) 
shown in the Recap of Fall *70 Testing Activities table Is: 

( ) correct 

< ) Incorrect; the niudbers should be: 

classes tested 

classes not tested. 



3 • Other comments and suggestions • 
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STANFORD RESEARCH INSTITUTE 



To: 



Blnet Testers 



Dale: 



August 24, 1970 



From: 



Becky Simons 



Location: Mcnlo Park, California 



Subject: Background Information 



In order to complete our files, we will appreciate your forwarding the 
enclosed form to the Instructor of your class In Individual testing with 
the request that It be returned to us as soon as possible. A return 
envelope Is Included for his use. 

If we do not already have a Head Start Application Form on file for you, 
I am enclosing one for you to complete and return to this office at your 
earliest convenience. 

Information regarding travel to your training session will be forwarded 
shortly. 



BS:gg 
ends. 
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Appendix D 

SPRING 1971 COMMUNICATIONS 
CONTENTS 



Date 

* 2 Feb 71 

* 3 Feb 71 

* 3 Feb 71 
*12 Feb 71 

12 Feb 71 

17 Feb 71 
19 Feb 71 
19 Feb 71 
19 Feb 71 
19 Feb 71 

19 Feb 71 

19 Feb 71 

22 Feb 71 
*24 Feb 71 



To 



HSDs 



SC 

HSPV Spons. 

HSD 

COS 



Jo int 
Fellows 



CDs 



CDs 



8BST 



Atlanta- 
boui 
CDs 

Denver- 
bour 
CDs 

Phlla.- 
bour 
CDs 

CDs 

HSD 



bound "old" 



bound "old" 



bound "old" 



Subject 

Ratings of PV and Cp 
Teachers 

HSD Ratings of Teachers 

Ratings of PV Teachers 

Dates of Easter Recess 

Special Codes for CO. Training 
Sessions 

Proposed Variables for C.O. 
Analysis 

4-Day Training Session - 
Philadelphia 

4-Day Training Session 
Atlanta 

8-Block Sort Training 
Session 

Refresher Training Session 
and 8-Block Sort Test 



Refresher Training Session 
and 8-Block Sort Test 



Refresher Training Session 

Travel Information 
Ratings of Teachers 



D-3 



-150 



CONTENTS (Concluded) 



Date 


To 


c 

Subject 




▼ 1 Mar # 1 


Dinex lesxers 


oprxng lesx fians 


D-lU 


* 1 Mar 71 


HSD 


Spring 1971 Testing Plans 


D-12 


* 2 Mar 71 


SCS| Level 
II and III 


Spring 1971 Testing Alert 


D-16 


* 4 Mar 71 


HS Eval. Ad- 
visory Coun. 

& HS pT*oflri*ntn 
w A ^ mil 

Consultants 


Information Copies of SRI 

Memos Relevant to the HSPV Eval« 


D-18 


29 Mar 71 


SCs 


Instructions for Completing HS 
Invoices 




* 1 Apr 71 


OCD 


Re Green Panel Report 


D-19 


* 2 Apr 71 


SCs, Level I 


Spring Data Collection 


D-25 


* 7 Apr 71 


SCs, Level II 


Spring Data Collection 


D-27 


* 7 Apr 71 


SCS| 

Level III 


Spring Data Collection 


D-34 


*15 Apr 71 


SCs, 

Level III 


Binet Testers for Spring 71 


D-44 


*16 Apr 71 


SCs, Levels 
II and III 


Additional Directions for 
Spring Testing 


D-45 


*16 Apr 71 


SC, Level I 


GIF and Questionnaires 
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*26 Jul 71 


HSPV Spons 


Implementation of Progress 
for 1970-71 

D-4 
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MEMO 



TO: 



Head Start Directors 



DATE: 2/2/71 



SUBJECT: 



PROM: 



Tor Meeland "^/^^ 

Ratings of Planned Variation and 
Comparison Teachers 



CO: 



LOCATION: 



A portion of the data needs for the PV Evaluation concerns the 
ratings that we must ask each Head Start Director to make about 
how well the teachers are performing as Head Start teachers*. I 
have enclosed a rating form (very similar to the one used last 
year) that contains the names of the teachers in whose classes 
SRI has been collecting data. 

Will you please make the ratings according to the instructions 
printed on the reverse side of the blue rating form. 

The ratings that many of you made last year provided an extremely 
important adjunct to the ohildren*s data^ class observations, etc. 
Tlie findings from last year *s evaluation activities are contained 
in the report sections submitted to OCD for review and approval 
prior to printing. Partly due to the wide scope of information 
collected last year and the need to examine a great many features 
and conditions of PV, the volxune grew in size and complexity. We 
wish we could have completed the work sooner. 

If you have aiqr difficulties with the ratings please call me (collect) 
at: 

Stanford Research Institute 
Menlo Park, California 94025 
(415) 326-6200 ext. 2682 
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MEMO 



TO: 



Site Coordinators 



DATE: February 3, 1971 




CC: 



LOCATION: 



Each Head Start Director in the PV Evaluation has been asked to 
rate teacheij in the classes where SRI collected data last fall. 
A copy of this form and the covering note is enclosed for your 
information. Incidentally, a form similar to this Is sent to 
each sponsor of a PV program for ratings on the level of imple- 
mentation of the model by the teachers of his model. The Head 
Start Directors* rating is only concerned with performance of 
the teachers as Head Start teachers. 

Coordination on the spring testing dates will be completed at 
CCD, Head Start, Washington D.C. on Monday, February 8. Imme- 
diately thereafter, we will send you the test schedule and 
details on procedures. If you know you will be unable to assist 
us during the spring period (essentially during the month of 
Hay) , please let me know so that a replacement can be arranged 
in coordination with the Head Start Director. 



I* 
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MEMO 



OATE: February 3, 1971 

LOCATION: 
CC: 



j 

t 

i 

Enclosed are rating forms (pink) containing the names of the 
teachers in your PV program. There is one sheet for each 
community. 

Will you please rate the performance of these teachers according 
to the instructions on the reverse side of the forms. 

The listing of teachers on each form separates teachers whose 
classes had SRI pupil testing from those from whom SRI obtained 
only demographic information (the Classroom Information Form) and 
Teachers* Ratings of Children (the California Preschool Social 
Competency Scale). If you used teachers who are not listed, I 
would appreciate your adding their names. Also, there may have 
1 been replacements since October 1969. Please substitute their 

names and give ratings for the appropriate time periods. 

I have also enclosed a copy of the Teacher Rating forms sent 
to the Head Start Directors and the cover memo. 




TO: Head Start Planned Variation Sponsors 
FROM: Tor lieeland //^^^l-^ 
SUBJECT: Ratings of PV Teachers 
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TO: Head Start Directors 

FROM: Tor Meeland 

SUBJECT: Dates of Easter Recess 



MEMO 



DATE: 2/12/71 

LOCATION: 

CC: 

Re£: HS-105 



Since we are trying to avoid scheduling testing activities during the Easter 
vacation, we need to know the days your centers will be closed for the Easter 
recess. Please show these dates below and return this memo in the enclosed 
self-*addre88ed envelope as soon as possible* 



Site: 



Center* 



Dates of Easter Recess 



ERIC 



* Probably all dates are the same, but if not, please show the differences by 



center* 



TMrgg 
Encl« 
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TO: , Head Start Director 

FROM: Tor Meeland 'J^y 
SUBJECT: Ratings of Teachers 



MEMO 



OAT6: 2/24/71 
LOCATION: 

CC: 

Hef: IIS 132 



Recently you should have received a teacher rating form (a blue 
sheet with a cover memo dated February 2, 1971) with a request 

that you complete them by February 15th • 

If you have not already done so, I would appreciate it very 
much if you would coiq)lete the forms and return them to me 
as soon as you can. 
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MEMO 



TO: Binet Testers date: March 1, 1971 

FROM; Phil Baker location: 

SUBJECT: Spring Test Plans cc: 

Ref: HS-144 



The pupil testing for spring 1971 will begin 
• y and must be completed in three 

weeks. This note is to esk you if you will be available to 
administer the Binets again (with the Birch scoring) during 
this period. 

We will continue to pay $15 for each Binet, but will forgo 
the training session on the Birch scoring since you already know 
the procedure. However, to remind you of the details of scoring 
that must be observed, a subsequent note will be sent to you 
along with suggestions on recording Which will simplify our data 
processing. 

If you wish to administer the Binets during the period 
shown above I please return the enclosed notice. If you do not 
respond by March 15, 1971, we will assume you are unavailable and 
we will arrange for a replacement tester. 

Thank you for your help last fall and I hope you will be 
available for the spring tests. 
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To: Tor Heeland 

Head Start Planned Variation Evaluation Project 
SRI 

lienlo Parky California 



( ) I will 

( ) I will not be available during the spring testing period 
to administer the Binets (with Birch scoring). 



If you are not available, can you recomnend another 
person for this work? 

Name 

\ 

Address 



t 

i 

i 

i Phone 



Submitted by: 



Date 

Head Sib art Community 



ERLC 
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MEMO 



TO: Head Start Directors OATE:March 1, 1971 
prom: Tor Meeland y^^^ location: 
SUBJECT: Spring 1971 Testing Plans cc: 
Ref: HS-145 



In a note to each of you, December 24, 1970, I briefly summarized the 
fall 1970 testing experience and gave a brief preview of the spring 1971 
evaluation activities that must be implemented by SRI under its contract to 
the Office of Child Development, HEW* 

Following are the activities that are underway for the spring period* 
If the dates and plans described conflict with your current plans, PLEASE 
inform me by letter or phone — collect to (415) 326-6200, extension 2682— 
in order for a sensible accommodation to take place* 

1. Head Start Directors* Ratings of Teachers, (Level I, II, fc III) 
The forms and instructions were sent on February 2, 1971, with a request 

that the ratings be completed by February 15, 1971, and returned promptly* 
All but six communities have responded and a reminder has been sent to those 
Head Start Directors. Often those ratings are difficult to make and we 
sincerely appreciate the effort^.* you have made to complete them; they form 
an important portion of the Planned Variation Evaluation data analysis* 

2. Spring Testing Schedule (Level II and III only) 

Based on the dates of last day of class that you supplied us, the testing 
schedule has been arranged to permit the completion of all work before the 
last week of class, or Hay 28 at the latest. The following dates apply to 

, Level : 



a* Last day of class: 

b* Class observations begin: 

c* 8-Block Sort Testing begins: (Level III only) 

d. Pupil testing begins: 

e* Teacher Ratings (California Preschool Social Competency 
Scale: 

Attached is a copy of our work calendar for spring 1971* If the dates 
are incompatible with your program of activities, PLEASE inform me* 



3. Class Observations (Level II and III only) 
Training sessions for the class observers will be held during the first 
two weeks of March. New and replacement observers will receive the full, 
five-day training program. Refresher courses of one day are scheduled for 
observers who worked in the fall 1970* Level III observers will be trained 
for the 8-Block Sort (see item 4, below). The dates and locations of these 
traiuinff sessions are as follows: 

8R1 M03 R2 



Date 

March 1-3 

March 3 
March 4-5 
March 8-11 
March 12-13 



Place 



Denver y Col. 



Atlanta, Ga. 
tf 

ft 

ft 



Hotel 



Sheraton Inn 



Sheraton Blltmore 
It 

tf 

tt 



Type 

Refresher + 8-Block 

Refresher 
8 -Block 
Full Course 
8-Block 



March 4 
March 8-11 
March 12-13 



Philadelphia, Pa. 



Benjamin Franklin 
tf 



Refresher 
Full Course 
8 -Block 



4. _8-Block Sort. Mother-Child Interaction Test (Level III only) 
This test was not administered in fall 1970 but is included in the spring 
testing. Only the mothers of t^e children who do not take the Binet will 
participate in the 8-Block Sort. The scheduling of the mothers is to be 
arranged by the Site Ck>ordinator, thus avoiding any involvement on the part of 
yourself or your staff. (If, however, you wish to make these arrangements, 
we will be glad to pass the task to you; the scheduling is a time comsuming 
affair and I recommend that you do not volunteer your services! ) 

In some communities it is necessary to begin the 8-Block Sort testing 
before the pupil testing in order to insure that the tests are completed 
before the last week of class. The schedule shown under item 2 (above) 
reflects this. The procedure differs from last year (1969-70) in that the 
class observers (see above) will receive training for the administration and 
scoring of the 8-Block Sort test,, and train the 8-Block testers (at the home site) 
to be able to teach the mother the task to be done. We have chosen to follow 
this procedure for two reasons: 

. a) since the observer is highly trained to record interactions, she can 
most effectively score the testing and 

b) it is possible to reduce the travel costs of the 8-Block training 
sessions. 



5. Parent Questionnaire (Level III only) 
When the mother comes in for the 8-*Block Sort test, she will be presented 
with a Parent Questionnaire which is to be completed before she leaves. We 
hope to have a satisfactory Spanish version for those mothers who find it 
easier to read in Spanish. In the case of mothers who have difficulty in 
reading, it is our plan that the 8-Block tester will read the questions aloud. 

The Parent Questionnaire is being submitted to CCD for review and comment. 
The final version will be sent to you before the test period in order for you 
to examine the format and contents, review it with your PAC chairman and, if 



In the Gordon modeli the 8--Block Sort will be administered by SRI and 
Gordon personnel; in no case will a mother/child be tested on the 8-Block by both 
SRI and Gordon. The scheduling of test will be coordinated between SRI and Gordon. 

.460'" 



0 



any portions of it seem inappropriate, PLEASE inform me of the items or sections 
that you wish eliminated or altered for your community. Although we have 
given the questionnaire to Head Start mothers in our field trials and have 
altered the form and questions as a result of these mothers* critic isma, we 
still wish to be responsive to your particular needs. 

The Parent Questionnaire has been reduced in size over last year in 
order to expedite its completion; it should take from 20 to <0 minutes to 
complete, depending upon the reading speed of the mother. 

6. Compensations to the Mothers (Level III only) 
In view of the extra time that the mothers must spend in completing the 
Parent Questionnaire and the fact that babysitting expense will be incurred, 
we will pay an honorarium of three dollars ($3-00) to each mother who conrpletes 
the questionnaire. The money will be given in cash when the task is co-upXeted 
(and thus avoid the usual delay of payment by check.) 



7. Teacher and Aide Questionnaire (Level I, II aric f II t ] ) 
A revision of the spring 1970 Teacher Questionnaire is b'eing submitted for 
review and approval along with a shortened, modified version to be given to 
the teachers* aides. The Aide Questionnaire is also to be available in a 
Spanish version for the convenience of those who prefer to read the questions 
in Spanish rather than in English. 

As with the Parent Questionnaire, the final versiovi vlli be submitted to 
you for examination and review (with your PAC chairman) lit f>n2or to identify 
those questions which you feel are inappropriate to your community. Please 
send your criticisms to me so that we can agree on which questions should be 
eliminated or altered. Although we have given the revised questionnaires to 
Head Start teachers for criticisms, and made several sensible changes, still 
would like assurance that the questions are appropriate to your community and 
do not impose on the privacies of yo\xr teachers and aides. 

The Teacher and Aide Questionnaires will be distributed by the SRI Site 
Coordinator during the testing period. The Site Coordinator will give the 
necessary supplementary instructions and stamped envelopes to be used for 
the direct mailing of each questionnaire to me at SRI. In this way we can 
easily maintain the privacy of the Teacher and Aide Questionnaire responses. 

0. Ethnic Culture Tests (Level II and III) 
The Children's Cultural Awareness Scale and the Ethnic Identity 
Questionnaire were administered last fall in those communities that were willing 
for the tests to be given. These two tests are included in the Auxiliary 
Battery for sprihg 1971, but will be given only if you agree to it. Attached 
is a copy of the memo I sent you last fall concerning these tests. 

Again, I ask that you confer with your PAC chairman and decide if one or 
both tests should be given to the children we test in your centers. Even if 
the tests were not given last fall, I hope you will give approval for their 
administration this spring. 

Enclosed is a form on which you can enter your preference. Please return 
it. to me as soon as possible in order that the packing of the test material 
kits can be modified as needed. 



9. SRI Site Coord inatbra 
The Site Coordinator remains our most Important contact with you. He 
(or she) will see that the Auxiliary Battery testers are available, retrained 
and scheduled to the proper centers or class after coordinating thoroughly 
with you. Again, they have two Important tasks: a) to see that the testing 
and data collection are accomplished In the prescribed manner and b) to see 
that the testing activities are coordinated through you and to cause a 
minimum of Interference with the program of Instruction scheduled for the 
children. Since each of you has been Instrumental In the selection of the 
SRI Site Coordinator, I really can't foresee any serious problems, but should 
a disturbance occur, PLEASE call me promptly so that the children's programs 
can be minimally disrupted. Parenthetically, I must add that the SRI project 
team has been exceptionally pleasted with this year's procedure whereby each 
Head Start Director has b^i a dominant role In the selection of the Site 
Coordinators. Along with your help in Identifying class observers and 
Auxiliary Battery testers, it is hard t^ envision a more practical procedure 
for assembling testing teams for natlon*-wide effort. Our successes are 
hugely due io your support; any f&iJA?res must be blamed on us in our follow- 
up and coord iha'^ ton ef,7i>rts» 
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MEMO 



TO: 



Site Coordinators^ Level II and III 



DATE: March 2, 1971 




LOCATION: 



CC; 



Ref: HS-146 



Enclosed is a copy of the memo I*ve sent to each Head Start 
Director describing the activities and procedures for the spring 
testing activities. It also identifies the dates for the various 
evaluation activities. Since you will be involved in some retrain- 
ing of Auxiliary Battery testers and arranging for the scheduling 
of mothers for the 8-Block Sort, the period during which we wish 
you to work will begin approximately 10 days prior to the testing 
period (or 8-Block testing if it occurs earlier). 

If you will be available during this time, please complete 
and return the enclosed sheet by March 15, 1971. If I do not 
hear from "you by this date» 1*11 assume you are unavailable and 
will arrange for a replacement. 

Further details of the spring testing procedures will be 
sent upon confirmation of your availability. 
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To: Tor Heeland 

Head Start Planned Variation Evaluation Project 
SRI 

Henlo Park I California 

I will ( ), will not ( ) be available this spring to 
serve as a Site Coordinator for the Head Start Planned Variation 
evaluation being conducted by Stanford Research Institute. 

If you have some minor conflicts in time, please note them 
below: 



Signed: , 

Site Coordinator Date 



Community 
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TO: 



Head Start Evaluation Advisory Council 
Head Start Program Consultants 



MEMO 



DATE: March 4f 1971 



FROM: Tor Heeland 



SUBJECT: Information Copies of SRI Memos Relevant to the 
Head Start Planned Variation Evaluation 



LOCATION: 
CCs 

Ref: HS-148 



1. Dr. LolB-ellln Datta, Chief, Evaluation Branch, OCD-Head 
Start, has suggested that you be added to the distribution 
list for copies of memos that pertain to SRI evaluation 
activities, plans and procedures concerning Planned Variation. 

2. Enclosed Is a set of back memos that Dr. Datta felt you » 
should have. 

3. We will be pleased to send you copies of future correspondence 

related to the Head Start Planned Variation evaluation. . 
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STANFORD RESEARCH INSTITUTE 
MENLO PARK. CALIFORNIA 94025 
(416) 326-e200 



April 1. 1971 



Dr. LoiB-*ellin Datta 

Chief, Evaluation—Head Start Evaluation 
Donahue Building~*400 W. 
8th and D Street S.W. 
Washington D.C. 20024 



Dear Dr. Datta: 

In your memorandum of March 24, 1971 you requested a written statement from 
me regarding the report of the Special Review Panel of Dr. Robert L. Green, 
Dr. Lawrence W. Lezotte, and Dr. John H. Schweitzer. 

We are pleased to have the opportunity to review the report of the Special 
Review Panel. We concur in general with the considered recommendations of the 
Panel. However, our comments are concerned with providing additional infoma-* 
tion, some of which, may correct mis impressions in specific aspects of the 



In considering my comments, the reader should keep in mind that the Special 
Review Panel spent less than two days at SRI. It is no criticism of the Pauel 
to recognize that their report perforce must be superficial in some respects. 
It is literally not possible to perform a thorough review of many man years of 
effort in less than two days. 

I question the propriety of disseminating so widely the Panel's report. 
Therefore, I am sending copies of this letter to the addressees of your memoran- 
dum. 

With regard to the recommendations made: 

a) SRI agrees to the need to continue Its general evaluation activities 
and thus provide continuity in the many interrelated tasks associated with the 
data collection effort, and capitalize on the proficiencies built up over the 
past three years. 

b) There is no doubt that the ways in which the Institute's capmbilities 
have been organized and allocated to the Head Start evaluation and the Follow 
Through evaluation has, in many instances, been less satisfactory than had been 
hoped. It is also true that the Institute's breadth and depth in certain areas 
has proved to be less adequate to some tasks than we had originally estimated. 



report. 
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CABL6: STANRE8. MENLOI^ARK / TWX 910'373*1246 / TELEX: 34S 400 



Difficulties in insuring adequate involvement by persons appropriately skilled and 
experienced in multivariate analyses and with appropriate backgrounds in child 
development and early education did lead to some sub-optimum arrangements this 
past year. We have made continuing efforts to acquire additional staff for both 
the Head Start and Follow Through projects. Some of these efforts have been more 
successful than others. Our Judgment coincides with yours and the Panel's; the 
most serious gap not yet adequately filled is for persons who embody recognized 
expertness both in early childhood programs and the evaluation craft. This has 
the highest priority in our staffing efforts anid we are diligently pursuing it. 

c) The possibility of developing subcontracts or grants with centers of 
expertise around specific questions for in-depth analyses strikes us as a construc- 
tive suggestion. There are, of course^ many specific and important questions 
that could and should be considered in greater depth than is ever likely to be 
possible within the constraints of the evaluation timo table. We feel that there 
might be some hazard to the overall evaluation and its time schedule , however , 
unless such in-depth analyses were conceived as adjunct and complementary to the 
basic analyses undertaken to fulfill overall evaluation requirements. 

Producing and making available analytic tapegu. derived from the data bank 
(based on specifications developed by the investigating team from the data bank 
tape descriptions) is, of course, feasible and relatively straightforward. The 
costs involved in producing analytic tapes from the total data bank are sufficiently 
large to dictate that this process must be budgeted for, but the obstaclesi if any, 
are economic rather than technical. 

However, I would like to reinforce our strong belief that in-depth analyses 
should not be integral to the basic analyses for the evaluation. They should 
complement and supplement the basic analysis and be scheduled independently from 
the overall evaluation. 

With respect to your cover memo (page 2): 

The impression that computer programs already available at SRI or elsewhere 
have been duplicated unnecessarily is not an accurate inference. Some of the 
programs we use are extensive adaptations of programs originally developed else* 
where. Adaptations are necessary (including debugging) whenever a program 
developed originally in one language or for one system is used in another. 
Occasionally, we find that it is more efficient and economical to develop a program 
for our own system rather than adapting one developed elsewhere. As a matter of 
policy, however, our practices are guided by pragmatic considerations; i.e., 
adopting the approach that will produce the desired program most efficiently. 

The following additional comments are addressed to the noted sections of 
the Panel *s report: 

1. Staff Organization and Managerial Capability 

We concur strongly with the observation that close planning liaison must be 
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maintained between the Head Start Planned Variation project and the Follow Through 
evaluation at the level of the responsible W&shington offices. We also recognize 
that this is difficult and that some differences in emphasis and timing probably 
inevitably will mean that the coordination cannot be perfect. 

An example not mentioned by the report of an issue of profound importance to 
both projects concerns the expected duration of both experiments, for this will 
affect planning through the 1971-72 year and beyond. Measurement in the Head 
Start Planned Variation experiment in the fall of 1971 could imply continuation of 
the Follow Through experiment at least through the school year 1975-76 if it is 
expected that the cohort group who enter Planned Variation this fall will be 
followed through a full term of participation in Follow through. On the other hand, 
if termination is anticipated for the Follow Through experiment before that time, 
then it might be more important for energies in the Planned Variation experiment 
this coming year to be directed toward follow up of the 1969-70 and 1970-71 
children who have already experienced Planned Variation. 

There is an implication in the report of capricious changes in the Follow 
Through time schedule and plan that were detrimental to Head Start, An example 
given refers to a last minute change in testing dates in Follow Through, This is 
not literally correct. There were some crossed signals on the timing of classroom 
observations in the fall of 1970 in Follow Through. The absence of full and easy 
coordination between Head Start and Follow Through on classroom testing, however, 
was primarily a function of Follow Through school calendars not always coinciding 
with Head* Start center calendars, 

2, I ns trumenta t ion 

We agree fully to the desirability of a full review of the test battery in the 
context of an explicit rationale for all variables and particular instruments. 
Naturally, revisions should reflect experience and new instrumentation should be 
field tested before use. 

3. Research Design 

The Pftnel report asserts that "all the sponsored groups have been lumped as 
the experimental group whibh is compared with a control group consisting of all the 
comparison groups." This appears to be a misinterpretation, as a reading of the 
report of these analyses will demonstrate. In some presentations, groupings have 
been made but the evaluation project has never lost sight of the primary objective 
of assessing the relative effectiveness of different approaches against a variety 
of criteria. The 1969-70 report did cluster approaches into classes consistent 
-with a similar clustering followed in the Follow Through evaluation^ This was done 
consciously to preserve the anonymity of particular approaches until a solid assess- 
ment of implementation was possible. 

The problems associated with selecting for testing comparison groups and PV 
classes that contained no more than 50% Negro children have been commented on in 
the Progress Report of January 29, 1971, Prior to that, OCD was made, aware of the 
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possible consequences of achieving this forced racial composition. The Initial 
selection of classes to be tested had been done randomly when more than four eli- 
gible classes were available. Howeveri the sponsor sites i centers, and classes 
had not been assigned In random fashion originally. 

The report suggests that the fact of discrepancies between sponsored and 
unsponsored groups (experiments Is and controls) was a surprise and, further, that 
a "full time design specialist ... might have caught the problem sooner/' We 
believe It more likely that a quasl-experlment Inevitably must deal with the 
literal impossibility of achieving ideal post factum matching. On the general 
point of deslgni it is worUi noting for the record that a whole series of crltlcdl 
design decisions have been made in both Head Start and Follow Through prior to 
entry on the scene of an evaluation contractor; 

a. Overall program guidelines that defined program elements and 
general objectives have been set. Program sponsors who design 
the approaches have been selected and, to greater or lesser 
degree I the particular objectives of each of these approaches 
have been established. 

b. Locations in which the experiment is to occur have been made 
and the pairings between locations and approaches have been 
determined. Within each location i the identity of parti- 
cipating childreni families , and staff has been largely decided 
by the eligibility rules that characterize the program and the 
decisions described above. 

Evaluation activities must accommodate to these decisions. 

• 4. Data Collection 

We have not experienced as many difficulties in the Head Start evaluation with 
cooperation in data collection as has been experienced in Follow Through* At 
least two characteristics of the Head Start situation help account for this; 
(1) the fact that both sponsored and unsponsored Head Start programs are funded by 
Head Start and (2) the valuable assistance provided by the Head Start program staff 
headed by Dr. Jenny Klein. 

5. Data Processing 

Part of the Inference regarding security of the data is incorrect. The report 
stated, "when the data from the local sites are received at SRI| f substantial 
amount of time elapses before these data are coded." In fact, the average time 
that any given box of data is in the building prior to keypunching is about one week. 
Data are received over a period of a few weeks. Perhaps the Special Review Panel 
confused the elapsed time for coding all data with the time that any given amount 
of data is in the building* 

The Special Review Panel properly Inferred that the building is flammable. It 




is a wood frame structure, has stucco walls, a concrete floor and a composition 
roof, SRI has occupied many of these **temporary" buildings for 25 years without 
loss of a single one to firei. The building is checked by security guards at 
frequent intervals during non woxking hours. 

Even though our fire security record over a 25-*year period is perfect, we 
are accepting the recommendation of the Special Review Panel to improve the security 
of the data when it first arrives at SRI, I have requested our Director of 
Facilities to seek alternative quarters for storage of data or to increase the fire 
protection in the existing building. 

The concern expressed by the Special Review Panel on page 10 regarding "quality 
control" does not have a factual basis. Either the panel asked the wrong question 
or was given the wrong answer. We believe our quality control procedures are 
excellent. We do not think it is adequate as suggested in the Panel's report to 
recede "some small percentage of the records." We use 100% verification in 
transferring raw data to punched card records. In addition, we draw a random 
sample of original data records and check those against the processed data as 
they appear on magnetic tape in the data bank. This gives a check on a whole 
series of tasks that are performed on the data from the time it comes in the door 
until it becomes a magnetic record in the data bank. 

We do not understand what might have been said or seen that led the Panel to 
infer the absence of a close relationship between the design and statistical staff 
and the data coding and computer programming staffs. In fact, some of them are 
the same people and all of them are administratively responsible to the same 
supervisor, 

6. Computer Programmini? and Statistical Analysis 

Obviously our staff did not make clear to the Panel that the ten percent of 
one particular programmer's time was in addition to the 1.2 man years of program-* 
ming budgeted and being used during this contract period. The ten percent 
apparently! referred to the amount of a :supervisor*s time. 

The covariance analysis programming was basically completed prior to use by 
the IV project^ the advantages of the shift to a different strategy of analysis was 
not clearly appreciated until after the first batch of covariance output had been 
critically examined by sponsors, consultants, and staff. The procedure shift could 
be considered wasteful to the extent evolutionary and sequential examinations 
result in replacement (often only temporarily) of first procedures. 

The project st^ff thought it had clearly identified the reason for the rela- 
tive indeterminations of computer expenses. Programmer and machine costs are 
quite readily determined for a given analysis, but the recycling of data to 
correct gaps or exploit emerging finds constitute the area in which analysis costs 
are so typically underestimated. It is undoubtedly true that "the fear of cost 
overruns may be intimidating (the staff) from conducting all the necessary 
analyses." 
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?• Interpretation and Report Writing 



We agree with the statement that "people who have the responsibility for the 
final report must necessarily be involved with all phases of data collection, 
coding, analysis, and' interpretation." Agreeing with this position is not to 
deny that some of the difficulties encountered in completing analyses and the 
1969-*70 report occurred when some of these functions were compartmisntalized. 
Orchestrating these several functions in a context of large scale data collection 
and some massive data tabulation and computation tasks is, under the best condi- 
tions , complicated* Clearly a better balance needs to be struck between 
economies of expertness that can be realized when certain functions are treated 
as more or less discreet and the depth of understanding that analysts can achieve 
only when they maintain direct involvement in every stage • 

Thank you for this opportunity to add a lengthy post script to the Special 
Review Panel's Report. I hope these elaborations contribute to a more accurate 
portrayal of the problem areas in the large and complex FV evaluation program. 
We deeply appreciate the Review Panel's report which provides a valuable critical 
and professional assessment of procedures and capabilities in the PV project 
and specific recommendations for action* 



cc: ^Planned Variation Review Panel 
Planned Variation Sponsors 
Mr» Richard Or ton 
Dr* Jenny Klein / 
Pr» Philip Sorensen | 
Dr. Tor Heeland ! 
Dr» Robert Egbert 
Dr. Richard Snyder . 
OCD Evaluation Advisory Council 




Sincerely yours 



Harvey h. Dixon , Execulfive Director 
Urban and Social Systems Division 
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MEMO 



TO: 



Site CoordlnatorSi Level I 



DATE: 4/2/71 



FROM: 



Tor Heel and 




LOCATION: 



SUBJECT 



Spring Data Collection 



CC: 



Ref: HS 196 



Three items of data collection are to occur in Level I sites this spring: 

1. Updating of the Classroom Information Form data. 

2. Teacher ratings of children using the California Preschool Social 
Competency Scale (CPSC). 

3* Administration of Teacher and Aide Questionnaires. 

These activities should take place during the two weeks prior to the 
last week of school but not later than May 28 (in the case of classes that 
continue in session past June 4). The attached calendar shows the data 
collection period for your site. It will require 3 to 6 days of your 
time, depending on the number of classes in your site. 

Classroom Information Form (CIF) 

We will provide you with computer print out copies of the CIF data 
obtained last fall and indicate which missing information (if any) is 
needed. 

There are a few new items of information that must be collected concerning 
dates children left the class, absences, etc* The teacher should be able to 
provide this for you. 

California Preschool Social Competency Scale (CPSC) 

The CPSC is to be completed by all the teachers that filled in the 
ratings last fall i.e. , all PV classes. Again we will pay them a stipend of 
$10.00 for their efforts. Since they are now familiar with the form and 
know thetr children more intimately, the time needed to complete the ratings 
should be much less than fall 1970. 



Teacher Questionnaires 

Each teacher will be asked to complete a Teacher Questionnaire similar, 
but shorter, than the one used last spring. Return envelopes will be 
provided for her to mail them back to us directly. You will need to distri- 
bute the questionnaires and instructions and follow up to see that the 
questionnaire was completed and sent back to us. 



Aide Questionnaire 

Each aide will be asked to complete a questionnaire similar to the 
Teacher Questionnaire, but shorter. A Spanish version is to be available 
for those aides who have difficulty reading English and who are more 
comfortable reading Spanish. The questionnaires are to be returned directly 
^ to us by the aides in envelopes we will provide. You will need to. distribute 

the aide questionnaires and instructions and follow up to see that the 
questionnaire was completed and sent back to us. 
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Level I Spring 1971 Data Collection Periods 
for Head Start Planned Variation Evaluation 



Community 

Buffalo, New York 

Salt Lake City, 
Utah 

Lakewood, 
New Jersey 

Tuskegee, Alabama 

Central Ozarks, 
Missouri 

Jacksonville, 
Florida 

St. Thomas, 
Virgin Islands 

Newburgh, New York 

Puerto Rico 



No. of Data Collection Last Day 

Classes Period of Class 

12 May 17-28 Unknown 
6 May 17 - 28 Unknown 

8 May 17 - 28 Unknown 

13 May 10 - 14, 

24 - 28 July 30 

16 April 5-16 April 23 

3 May 17 - 28 Unknown 

14 May 17 - 28 June 25 
8 May 17 - 28 June 25 
6 May 17 - 28 July 30 
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MEMO 



O 



Site Coordinators, Level II 



DATE 4/7/71 




CC; 



LOCATION' 



Ref:HS-199 



The spring testing period will begin soon. The attached calendar 
shows the critical dates for each community. This Is a "cumulative" 
calendar on which the changes in scheduling that occurred can be identi- 
fied. 

You have already received an Intormation copy of the memo to the 
Head Start Directors (dated March 1, 1971) which described the activities 
that will take place this spring. This memo covers some hew Items and 
generally Is concerned with 'administrative and coordination matters. 

1. Pay Schedule for Spring 1971 

Just a reminder of the various pay rates and stipends that are pro- 
vided for spring 1971: 



Training. Stipend 



Pay Rate 



a) Auxiliary Battery 
Testers 



$20 for retraining 
$40 for training new 
ABT 



$2. 20 /child tested 



b) Classroom Observer 



(already finished) 
I.e. , $50 training 



$15/cla8S day of 
pbservat ion 



stipend for new CO + 
$25 home study or $20 
stipend for refresher 
course. 



c) CPSC (California 
Preschool Social 
Competency Scale) 



$10/teacher for 
completing forms 
for all children 
in her class. 



d) Teacher and Aide 
Questionnaire 



no stipend is given for 
this activityi according 
to agreements with Off- 
Ice of Child Development 
(OCD) Washington, D«C. 
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2. Order of Testing 

You will receive a computer print-out of children in each class based 
on the pupils tested last fall. The Order of Testing print-out shows 
vihich children are to receive tests this spring. The names of the child- 
ren in this listing have been randomized and show the order in which each 
child is to be tested. You must follow this order. If a child is absent 
when scheduled for a test, pick him up at the end of the testing. New 
children in the class are not to be tested , although they are to be added 
to the Classroom Information Form and date entered as shown in the instruc- 
tions to the GIF that you will receive. 

3. Class Observations (CO) 

The COS are underway in almost all communities. Because of the nature 
of the CO and the detailed training that is involved, we have planned for 
almost all of the coordinating and scheduling to be done by the observer, 
even though this procedure leaves the Site Coordinators left out of the 
activity. We have, however, asked that the Site Coordinators (SC) sign 
the invoices of the observers as a minimum check that the classes were indeed 
observed. Since the SCs cannot check on the quality of the CO due to the 
extensive training that is necessary to do this task, we expect only that 
the SC will check that the CO has completely filled in her forms. The 
best way to do this is to ask her to check each item on her green sheets, 
to be sure everything is filled in. We ask the SCs to send the observation 
forms to SRI in care of the National Computer Systems (NCS), Minneapolis, 
Minnesota in the box provided to the CO. NCS prints our forms, scores the 
CO forms and prepares the data tapes for us. Do not send the CO forms to 
SRI , since it only causes a huge delay in transshipment. 

4. Auxiliary Battery Testing (ABT) 

The ABT is the same as last fall. The attached updated testing calendar 
shows those communities who^e Head Start Directors have given permission 
for the administration of the ethnic tests (the Children's Cultural Aware- 
ness Scale (CCAS) and/or the Ethnic Identity Questionnaire (EIQ)). In 
those places where we have not received word from the Head Start Director 
at the time of shipping, we have included both tests — Just in case. Please 
check with the Head Start Director as to whether either or both ethnic tests 
are to be given. The choice to give these tests rests with the Head Start 
Director, so please don't try to talk them into iti 

The pay rate for the ABT was based on a great deal of experience from 
last year. At $2.20/tested child, the ABT should make more than $3.00/hdur 
which is a very good return for the skill level required. In the case of 
testers who take 45-60 minutes to complete the test, please observe them 
carefully, and show them how they can be more efficient in their testing. 
If the tester is completing the tests in less than 25 minutes, please 
check carefully— the child is probably being rushed. Remember, the child 
must never be penalized. In some circumstances, a child may be untestable, 
but assuming the tester has made every necessary and appropriate effort, we 
still pay the tester for her effort. Her tester log must explain why the 
tests could not be completed. 




I*m not sure Jusit what explicit guidance to offer in these cases, 
but as a general rule, please mnke sure the tester does not rush (on 
the other hand, she should not dilly-dally aroUnd) and should be very 
sincere in her efforts to establish a reasonably good rapport with the 
child* 

We have been criticized about the number of children who have refused 
to take the tests or who have cried so much that testing was impossible. 
I have counter-? rgued r.hat the tester* s manner and the procedures followed 
have been good and the failures to complete tests is a natural result 
of the children being unprepared for the stresses of testing — and will 
learti to accommodate to these stresses as they progress in the Head Start 
pr«>gran!3. If the testers are at fault, please correct the procedure or 
replace the tes^r.r. This is most important. All of you, as Site Coordina- 
tors, are representing SRI in its efforts to conduct a national evaluation 
according to the highest st:mdards of excellence. That isn* t easy to do, 
considering the myriad difficulties and special instances that come up. 
On the plus side is the fact that we have been complimented, at a national 
level, on tne profession^skill of the field testing that has taken place, 
and that is a pexdonal kudos to each of you. 

5. Invoices 

In order to avoid the kick backs that the business office makes, 
Janny Brust has prepared a note on the things you must check on the invoices 
to avoid them b^^ing returned for correction. Since money Is serious, 
please be sure that all of the required Items are filled in as Janny has 
specified* (Every invoice Is subject to examination by auditors; thus the 
time, place and activity must be shown in detail.) 

6. Scheduling 

As noted in the beginning and shown In the attached calendar, the 
testing should occur within specified time limits. P lease dc not e^^pect 
to test during the last week of class; the teachers a.ce too busy and the 
closing activities will be a detriment to the testing. Although &^ome 
communities hold class during part or all of the summfrr period, no testing 
should occur after May 28. Alternate PV and comparison classes In testing . 

Exceptions ; 

a5 The Bank Street model (Boulder, Wilmington — not DeLaWar — and 
Elmira) Is conducting a review during the week of May 17 - 21 
and all testing must be avoided during the period. Please 
shift to the comparison classes (as available) during this period. 

b) The Gordon (Florida) model in Jonesboro« Chattanooga and Houston, 
administers the Preschool Inventory (PSI — our Book 5). We have 
always agreed not to double test the children and therefore the 
Site Coordinators In these communities must arrange tor make copies 
(xerox or other process) of the PSI form (Book 5) which Is admin- 
istered by the SRI Auxiliary Battery tester and leave the copy 
with the Head Start Director. If the Head Start office can 
make the copy, fine — otherwise, please get copies made and Include 
the cost on your Invoice or submit the bill to me directly. 
There Is not time to return the forms of the PSI to SRI for copying 
and then make a return shipment to the Florida people. 

- ♦ , • 
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c) In Seattle , no tests should be given during the period of May 
13-25. This may require an extra ABT and if so, please call 
Romaine Mason (phone (415) 326-6200, extension 4840) to alert 
her that an additional test kit is needed. 

7. Classroom Information Form (GIF) 

We will provide you with computer print-out copies of the GIF data 
obtained last fall and Indicate which missing Information (If any) Is 
needed. 

There are a few new Items of Information that must be collected concern- 
ing dates children left the class, absences, etc. The teacher should be 
able to provide this for you. 

8. GPSG (California Preschool Social Competency Scale) 

The CPSC Is to be completed by all the teachers that filled In the 
ratings last fall. I.e., all classes. Again we will pay them'a stipend 
of $10 for their efforts. Since they are now familiar with the form and 
know their children more Intimately, the time needed to complete the ratings 
should be much less than fall 1970. 

9. Teacher Questionnaire 

Each teacher will be asked to complete a Teacher Questionnaire similar, 
but shorter, than the one used last spring. Return envelopes will be 
provided for her to mall them back to us directly. You will need to distri- 
bute the questionnaires and Instructions and follow up to see that the 
questionnaire was completed and sent back to us. 

10. Aide Questionnaire 

Each aide will be asked to complete a questionnaire similar to the 
Teacher Questionnaire, but shorter. A Spanish version Is to be available 
for those aides who have difficulty reading English and who are more 
comfortable reading Spanish. The questionnaires are to be returned directly 
to us by the aides In envelopes we will provide. You will need to distribute 
the aide questionnaires and Instructions and follow up to see that the 
questionnaire was completed and sent back to us. 

11. Coordination with SRI ' 

Usually you have called me regarding troubles and although I'm willing 
to trouble shoot for you, some time can be saved If you call specific 
people for certain kinds of problems. I.e., 

a. Material (test) shortages — call Romaine Mason, ext. 4840 

b. Invoices and related pay problems — call Janny Brust, ext. 3038 

c. Class Observation problems— call Jane Stalllngs, ext. 3564 

d. Auxiliary Battery Test procedures — call Cindy Souza, ext. 4840 

or Tor Meeland, ext. 2682 

e. Classroom Information form — call Romaine Mason, ext. 4840 

f. CPSC (California Preschool Social Competency Scale)~call 

Tor Meeland, ext. 2682 or 
Klara Evans, ext. 2517 

g. Teacher or Aide questionnaire—call Mary Anastole, ext. 3668 

or Sandy Murphy, ext. 3503 
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12. Coordination with the Head Start Director 

Please bear in mind the critical need to coordinate your activities 
ivith the Head Start Director, She must be kept informed of the testing 
schedule and the demands you must make on the teachers to help complete 
the Classroom Information Form (CIF) and the CPSC (California Preschool 
Social Competency Scale) • Please accommodate to the needs of the teachers 
and the Head Start Director. The teachers , in particular, have a very 
difficult time incorporating the SRI testing into their class schedules 
and every effort should be made to minimize any possible commotion that 
attends the testing, 

A REMINDER : The most difficult task facing the evaluation project 
members has been the need to keep a "low silhouette'* in the evaluation 
activities. It is imperative that all persons engaged in the evaluation 
activities refrain from acting as "change agents,*' This means that every 
tester avoid the temptation to comment on the conduct of the classes or 
in any way make suggestions or critiques that can possibly be interpreted 
as criticizing or supporting the class activities. As testers in an 
evaluation program it is absolutely necessary that no comments be given 
to the teachers or the Head Start Director concerning the programs or 
activities that are observed. It is particularly important that the 
Class Observers be admonished to refrain from making any comments about the 
teachers* performance on any aspect of the models being implemented, I 
knv^w this is hard to do, but one of the basic requirements for the evaluation 
activities is to maintain an impersonal, objective and non-communicative 
stature. The findings of the evaluations are to be reported only after' 
the various lines of evidence have been explored. 

The SRI report on the first year evaluation of the Planned Variation 
program in Head Start was submitted to OCD (March 1971) for review, OCD 
will djBtermine the extent of distribution of this report and the nature 
of conununity feedback that will occur. Neither SRI nor you and your testers 
can offer any information until this OCD policy statement is available, 

I*m sorry to bear down on this issue, but we are all caught up in an 
exciting experiment with the futures of many young children and although 
the particular experiences we have had can easily precipitate comment, 
the professional and legal restrictions take priority. Please consider 
that the program we are assessing is a long term investment, i,e, , what 
is the accumulative benefits if any, of participating iu the various 
Planned Variations of educational programs from Head Start (pre-school) 
through at. least the third grade in school under the follow up in Follow 
Through. 

When our report on the first year's effort is released, I will make 
every effort to see that a copy of the report is provided each of you. 
Even for a first year, the findings are exciting and provide a good basis 
for growth and developraient of the childrein in the Planned Variation programs. 
But, again, I must admonish you to treat any comments as "administratively 
confidential" until such time as the refport is released. 



13* Comment 

The Buccess of the Planned Variation Evaluation depends to the greatest 
degree on the quality of the data collected at the sites* Every effort 
you make to Insure the credibility of the collect data provides a direct 
Impact on the quality of the evaluation. All of us on the project at SRI 
believe the stakes are high: the potential benefits to many children hinge 
on the exceptional performance of us, the Site Coordlnatorsi and the many 
testers involved* The obligation is awesome; the excitement and satisfaction 
almost without end* 

14. Materials 

The test kits (for Auxiliary Battery Testers) and the Site Coordinator 
kits will be shipped to arrive a week before your testing begins* 

The Site Coordinator kits. will contain spare forms if needed, along 
with copies of the Order of Testing lists* Instructions for all tests and 
procedures will be in your kit, expanding on the topics covered in this 
memo. A notice will be sent alerting you of the expected delivery date 
for the materials. If the shipment hasn't arrived by the date specified, 
please call Romaine Hasoi^ (41S) 326-6200 extension 4840, to learn of the 
shipping status* 

15* Finally 

As always, if you have doubts or issues that need attention, please 
call the one best suited to your needs-- see item 11 above. 
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TO: Site Coordinators I Level III date: 



FROM: Tor lleeland 




LOCATION: 



SUBJECT: Spring Data Collection • ' cc: 

Ref :HS-20l 



The spring testing period will begin soon. The attached calendar 
shows the critical dates for each community. This Is a '^cumulative'* 
calendar on which the changes In scheduling that occurred can be Identi-* 
fied. 



You have already received an Information copy of the memo to the 
Head Start Directors (dated March 1, 1971) which described the activities 
that will take place this spring. This memo covers some new items and 
generally Is concerned with administrative and coordination matters. 

1. Pay Schedule for Spring 1971 

Just a reminder of the various pay rates and stipends that are pro- 
vided for spring 1971: 

Training Stipend Pay Rate 



/ 



a) Auxiliary Battery 
Testers 



b) Classroom Obsearver 



c) CPSC (California 
Preschool Social 
Competency Scale) 



$20 for retraining 
$40 for training new 
ABT 

(already finished) 
1. e. I $50 training 
stipend for new 00 + 
$25 home study or $20 
stflpend for refresher, 
course. 



$2. 20 /child tested 



$15/class day of 
observation 



$10/teacher for 
. completing forms 
for all children 
In her class. 



d) Teacher and Aide 
Questionnaire 

d) Blnet Testers 

e) 8-Block Trainer 



no stipend is given for 
this activity! according 
to agreements with Off- 
Ice of Child Development 
(0(3» Washington I D.C. 

$ IS/hour ^ one hour 
training session 

(see paragraph 5 

.belbw)' -.!'.^// 



$15/test given 



2. Order of Testing 

You will receive a computer print-out of children in each class based 
on the pupils tested last fall. The Order of Testing print-out shows 
which children are to receive tests this spring* The names of the child- 
ren in this listing have been randomized and show the order in which each 
child is to be tested* You must follow this or6et\ If a child is absent 
when scheduled for a test, pick him up at the end of the testing. New 
children in the class are not to be tested , although they are to be added 
to the Classroom Inforaation Form and date entered as shown in the instruc- 
tions to the GIF that you will receive. 

3. Class Observations (00) 

The COS are underway in almost all communities* Because of the nature 
of the CO and the detailed training that is involved, we have planned for 
almost all of the coordinating and scheduling to ^e done by the observer, 
even though this procedure leaves the Site^Coordinators left out of the 
activity. We have, however, asked that the Site Coordinators (SC) sign 
the invoices of the observers as a minimum check that the classes were indeed 
observed. Since the SCs cannot check on the quality of the 00 due to the 
extensive training that is necessary to do this task, we expect only that 
the SC will check that the CO has completely filled in her forms* The 
best way to do this is to ask her to check each item on her green sheets 
to be sure eversrthing is filled in, We ask the SCs to send the observation 
forms to SRI in care of the National Computer Systems (NCS), Minneapolis, 
Minnesota in the box provided to the CO* NCS prints our forms, scores the 
CO foras and prepares the data tapes for us* Do not send the 00 forms to 
SRI , since it only causes a huge delay in transshipment* 

4. Auxiliary Battery Testing (ABT) * 

The ABT is the same as last fall* The attached updated testing calendar 
shows those communities whose Head Start Directors have given permission 
for the administration of the ethnic tests (the Children's Cultural Aware- 
ness Scale (OCAS) and/or the Ethnic Identity Questionnaire (EIQ))* In 
those places where we have not received word from the Head Start Director 
at the time of shipping, we have included both tests — Just in/case. Please 
chedk with the Head Start Director as to whether either or both ethnic tests 
are to be given. The choice to give these tests restis with the Head Start 
Director, so please don't try to talk- them into it! 

The pay rate for the ABT was based on a great deal of experience from 
last year* At $2. 20 /tested child, the ABT should make more than $3. 00 /hour 
which .is a very good return for the skill level required. In the case of 
testers who take 45-*60 minutes to complete tffe test, please observe them 
carefully, and show them how they can be more efficient in their testing. 
If the tester is completing the tests in less than 25 minutes, please 
check carefully— *t he child is probably being rushed* Remember, the child 
must never be penalized* In some circumstances, a child may be uitestable, 
but assuming the tester has made every necessary and, appropriate effort, we 
still pay the tester for her effort. Her tester log must explain why the 
tests could not be completed. . 
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I*m not sure Just what explicit guidance to offer in these cases, 
but as a general rule, please make sure the tester does not rush (on 
the other hand, she should not dilly-dally around) and should be very 
sincere in her efforts to establish a reasonably good rapport with the 
child. 

We have been criticized about the number of children who have refused 
to take the tests or who have cried so much that testing was impossible. 
I have counter-argued that the tester* s manner and the procedures followed 
have been good and the failures to complete tests is a natural result 
of the children being unprepared for the stresses of testing — and wiir 
learn to accommodate to these stresses as they progress in the Head Start 
programs. If the testers are at fault, please correct the procedure or 
replace the tester. This is most important. All of you, as Site Coordina- 
tors, are representing SRI in its efforts to conduct a national evaluation 
according to the highest standards of excellence. That isn* t easy to' do, 
considering the myriad difficulties and special instances that come up. 
On the plus side is the fact that we have been complimented, at a national 
level, on the professional skill of the field testing that has taken place, 
and that is a personal kudos to each of you. 

5. Eight -Block Mother-Child Interaction Task 

a. The 8-Block was not given in fall 1971. This spring the 
mothers of the children who do not take the Binet will 
participate in the 8-Block Sort Task, There are some excep- 
tions in the Gordon model communities — Jonesboro and 
Chattanooga — where a reduced number of 8-Block Ta:^ks will be 
given to avoid double testing of children already scheduled 
for testing by Gordon* s personnel. Also, as shown in the 
Order of Testing print-outs, some alterations are made to 
compensate for extra Binets given last fall, but in any case, 
please follow the notations shown for tests to be administered . 

b. Eight-Block Trainer - It will be necessary to hire an 8-Block 
trainer who should have the same qualifications as the Auxiliary 
Battery Tester. She will be instructed in the procedure by 

the Class Observer. These training procedures were covered 
in detail during the COs training (or retraining) session. 
The CO should explain the 8-Block Sort procedure to you. , 

i 

It would help to receive the 8-Block trainer* s application form 
as soon as possible in order to process the necessary paper 
work to insure that she is paid promptly. We must have her 
social security number and mailing address before she can be 
paid. " 

c. Training of 8-Block Trainer - The observer will re^^eive a 
stipend of $20 for the time she spends in training and prac- 
ticing for the 8-Block Task. 
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Testing the Mother-Child on the 8-Block Sort 

(1) The observer will be paid $3 for each mother-child 
participation. 

(2) The 8-Block trainer will be paid $3 for each mother who 
is Instructed on the 8-Block Sort and is given the Parent 
Questionnaire, (see 6 below) 

(3) Note ; Since the scheduling of the mothers into the 
centers can run into administrative troubles that are 
not the fault of the trainer and observer , we feel we 
should provide them with a minimum of $6 for each day they 
have scheduled tasks. With care in scheduling, they 
should be able to administer^the 8-Block to 4 or 5 (and 
even 6) mothers per day. 

e. Scheduling of the mothers will present a problem. Some will 
be unavailable due to Jobs or personal reasons; there may be 
no way to contact them by phone and transportation in some 
communities may be very difficult. It may be possible to use 
the Head ^tart office transportation facility to bring the 
mothers in for testing. In this case, we will pay 10 cents 
a mile for use of the car. (Your invoice should show this so 
we can reimburse the Head Start office directly. ) If the 
mother must use local public transportation, you should 
reimburse her and enter the amount on your invoice. 

Stipends for mothers - You will receive an advance for the 
payment of the mother's stipend ($5 times the maximum number 
of mothers to be tested plus $25 for the total local trans- 
portation — if needed). Upon completion of the 8-Block and the 
Parent Questionnaire (see below) the mother should be paid 
in cash ($5 + public transportation if required) after she 
signs the Honorarium Record. If the mother completes only 
the Eight rBlock Task, she receives $2. However, in Jonesboro 
and Chattanooga, the mothers are to be paid only ,$3 since no 
stipend can be offered for ^participation in the 8-Block to 
agree with the sponsor (Gordon) not paying^for his testing. 
To have two rates of pay would obviously be confusing and unfair* 
Her signature on this sheet which is in the SC kit is proof 
that the amount shown has been disbursed. Keep the balance 
of the stipend advance and it will be deducted from your 
invoice. You may at your option return the balance, however. 
Please remember to include the Honararium Record of the 
mothers* payments along with your final invoice or you will 
not be credited for money^ dispersed! 

If you have to drive to coordinate the attendance of the 
mothers for the 8-Block test, you will be reimbursed at the 
rate of 10 cents per mile, but you must show this on youir 
invoice. : 
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6. Parent Questionnaire 

During the period the mother is at the center for the 8-Block Sort 
task, she will be asked to complete a questionnaire to be administered 
by the 8-Block trainer (see below). A Spanish version will be supplied 
for those mothers who feel more comfortable reading Spanish* The 8-Block 
trainer is only an administrator of the questionnaire but in the event 
the mother is unable to read, the 8-Block trainer must present the question- 
naire orally. The trainer should show tact at this point so a mother who 
is illiterate does not feel dehumanized* Please suggest to the trainer 
a style and procedure to overcome the awkwardness that can result if a mother 
cannot read. For instance, the trainer can start reading each questionnaire 
for each mother and give up this task if the mother volunteers to read by 
herself. Remember that we sincerely wish the mother* s responses to be 
confidential to SRI (except if the trainer reads the questionnaire) and we 
have provided envelopes for the mother to insert her completed form so that 
the trainer is not party to the responses. However, it is important that 
the trainer, by asking the mother, be assured that every item has been 
answered. 

In the event the mother does not understand a question, it is preferable 
for the trainer not to explain the item and for the mother to write "don*t 
understand." It is permissible for the trainer to explain the meaning of 
words, however. 

7. Binet Testing 

The Binets with Hertzig-Birch scoring are scheduled for administration 
this spring to the children who received them last fall. The refreshing of 
old testers and preparation of new ones is being coordinated by Phil Baker, 
extension 3269. 

A check list of procedures and testing steps is included with the test 
formn in the Site Coordinators test kit. 

For the amount of money we pay the Binet testers,^ I't is reasonable to 
expect them to complete the fbxms as specified. Also, 30-45 minutes is 
a reasonable time for testing one child; longer if rapport problems are 
present; certainly not 10-20 minutes. Please watch the Binet testers 
carefully in the beginning to be sure that the testing conditions are good. 

• 8. Testing Space 

Space for testing will be a critical item in Level III sites since one 
or more Auxiliary Battery testers, Binet testers and the 8-Block Tesk 
require separate rooms or spaces. Where test space is short, you should 
consider doing the testing in different classes simultaneously, i.e., 
ABT in one (or 2 classes) Binets in a second and 8-Block in a third. 
Scheduling then becom[es a bit tricky, but with care, it could work. 



9, Invoices 

In order to avoid the kick backs that the business office makes, 
Janny Brust has prepared a note on the things you must check on the invoices 
to avoid them being returned for correction. Since money is serious, 
please be sure that all of the required items are filled in as Janny has 
specified. (Every invoice is subject to examination by auditors; thus the 
time, place and activity must be shown in^^detail.) 

10. Scheduling 

As noted in the beginning and shown in the attached calendar, the 
testing should occur within specified time limits. Please do not expect 
to test during the last week of class; the teachers are too busy and the 
closing activities will be a detriment to the testing. Although some 
communities, hold classt during part or all of the summer period, no testing 
should occur after May 28. Alternate PV and comparison classes in testing . 

Exceptions ! 

a5 The Bank Street model (Boulder, Wilmington— not DeLaWar~and 
Elmira) is conducting a review during the week of Hay 17 - 21 
and all testing must be avoided during the period. Please 
shift to the comparison classes (as available) during this period. 

b) The Gordon (Florida) model in Jonesboro, Chattanooga and Houston, 
administers the Preschool Inventory (PSI — our Book 5). We have 
always agreed not to double test the children and therefore the 
Site Coordinators in these communities inust arrange to make copies 
(xerox or other process) of the PSI form (Book 5) which is admin- 
istered by the SRt Auxiliary Battery tester and leave the copy 
with the Head Start Director. If the Head Start office can 

make the copy, fine — othejrwise, please get copies made and include 
the cost on your invoice or submit the bill to me directly. 
There is not time to retam the forms of the PSI to SRI for copying 
and then make a return shipn^ent to the Florida people. 

c) In Seattle, no tests- should be given during the period of May 
13 - 25. This may require an extra ABT and if so, please call 
Romaine Mason (phone (415 ) 326-*6200, extension 4840) to alert 
her that an additional test kit is needed. 

11. Classroom Information Form (CIF) 

We will provide you with computer print-*out copies of the CIF data 
obtained last fall and indicate which missing information (if any) ^s 
needed. 

There are a few new items of information that must be collected concern* 
ing dates children left the class, absences, etc. The teacher should be 
able to provide this for you. 

12. CPSC (California Preschool . Social Competency Scale) 
The CPSC is to be completed by all the teachers that filled in the 
ratings last fall, i.e., all classes. Again we will pay them a stipend 
of $10 for their efforts. Since they are now familiar with the form and 
know their children more intimately, the time needed to complete the ratings 
should be much less than fall 1970. 



13. Teacher Questionnaire 

Eac|i teacher will be asked to complete a Teacher Questionnaire similar, 
but shorter, than the one used last spring. Return envelopes will be 
provided for her to mail them back to us directly. You will need to distri- 
bute the questionnaires and instructions and follow up to see that the 
questionnaire was completed and sent back to us. 

14. Aide Questionnaire 

Each aide will be asked to complete a questionnaire similar to the 
Teacher Questionnaire, but shorter. A Spanish version is to be available 
for those aides who have difficulty reading English and who are more 
comfortable reading Spanish. The questionnaires are to be returned directly 
to us by the aides in envelopes we will provide. You will need to distribute 
the aide questionnaires and instructions and follow up to see that , the 
questionnaire was completed and s^nt back to us. 

15. Coordination with SRI 

Usually you have called mr regarding troubles and although I*m willing 
to trouble shoot for you, soce time can be saved if you call' specific 
people for certain kinds of problems, i.e., 

a. Material (test) shortages -*-call Romaine Mason, ext. 4840 

b. Invoices and related pay problems*-- call Janny Br us t, ext. 3038 

c. Class Observation problems-- call Jane Stallings, ext. 3564 

d. Auxiliary Battery Test procedures— call Cindy Souza, ext. 4840 

or Tor Heeland, ext. 2682 

e. Classroom Information form— call Romaine Mason, ext. 4840 

f. CPSC (California Preschool Social Competency Scale)— call 

Tor Meeland, ext. 2682 or 
Klara Evans, ext. 2517 

g. Teacher or Aide questionnaire— call Mary Anastole, ext. 3668 ^ 

or Sandy Murphy, ext. -3503 

h. Binet— call Phil Baker, ext. 3269 

i. 8-Block Sort— call Klara Bvans, ext. 2517 

j. Parent Questionnaire— call Mary Anastole, ext. 3668 

or Sandy Murphy, ext. 3505 



16. Coordination with the Head Start Director ' 

Please bear In mind the critical need to coordinate your activities 
with the^Head Start Director. She must be kept informed of the testing 
schedule aCnd the demands you must make on the teachers to help complete 
the Classroom Information Form (CIF) and the CPSC (California Preschool 
Social Competency Scale). Please accommodate to the needs of the teachers 
and the Head Start Director. The teachers, in particular, have a very 
difficult time incorporating the SRI testing into their class schedules 
and every effort should be made to minimize any possible commotion that 
attends the testing. \ 



A REMINDER ; The most difficult task facing the evaluation project 
members has been the need to keep a "low silhouette" In the evaluation 
activities. It Is Imperative that all persons engaged In the evaluation 
activities refrain from acting as "change agents." This means that every 
tester avoid the temptation to comment on the conduct of the classes or 
In any way make suggestions or critiques that can possibly be Interpreted 
as criticizing or supporting the class activities. As testers In an 
evaluation program It Is absolutely necessary that no comments be given 
to the teachers or the Head Start Director concerning the programs or 
activities that are observed. It Is particularly important that the 
Class Observers be admonished to refrain from making any comments about the 
teachers* performance on any aspect of the models being Implemented. I 
know this Is hard to 'do, but one of the basic requirements for the evaluation 
activities is to maintain an Impersonal, objective and non-communicative 
stature. The findings of the evaluations are to be reported only after 
the various lines of evidence have been explored. 

The SRI report on the first year evaluation of the Planned Variation 
program In Head Start was submitted to OCD (March 1971) for review. OCD 
will determine the extent of distribution of this report and the nature 
of community feedback that will occur. Neither SRI nor you and your testers 
can offer any Information until this OCD policy statement Is available. 

I*m sorry to bear down on this issue, but we are all caught up In an 
exciting experiment with the futures of many young children and although 
the particular experiences we have had can easily precipitate comment , 
the professional and legal restrictions take priority. Please consider 
that the program we are assessing Is a long term investment, i.e., what 
Is the accumulative benefits If any, of participating In the various 
Planned Variations of educational programs from Head Start (pre-school) 
through at least the third grade In school under the follow up in Follow . 
Through. 

When our report on the first year's effort Is released, I will make 
every effort to see that a copy of the report Is provided each of you. 
Even for a first year, the findings are exciting and provide a good basis 
for growth and development o£ the children in the Planned Variation programs. 
But, again, I must admonlsh*^ou to treat any comments as "administratively 
confidential" until such time as the report is released. 

. . 

17. Comment 

The success of the Planned Variation Evaluation depends to the greatest 
degree on the quality of the data collected at the sites. Every effort 
you make to Insure the credibility of the collect data provides a direct 
impact on the quality of the evaluation. All of us on the project at SRI 
believe^-tlie -atakes ^re.high: the potential benef its^ to many- ^lldren hinge 
-oh the exceptional performance of us, the Site Coordinators, and the many 
testers involved. The obligation is awesome; the excitement and satisfaction 
almost ^without end. 



18. Materials 

The test kits (for Auxiliary Battery Testers) and the Site Coordinator 
kits will be shipped to arrive a week before your testing begins. 

The Site Coordinator kits will contain spare forms If needed, along 
with copies of the Order of Testing lists. Instructions for all tests and 
procedures will be In your kit, expanding on the topics covel*ed In this 
memo. A notice will be sent alerting you of the expected delivery date 
for the materials. If the shipment hasn*t arrived by the date specified, 
please call Romalne Masoi\ (415) 326-6200 extension 4840, to learn of the 
shipping status. 

19. Finally 

As always, If you have doubts or Issues that need attention, please 
call the one best suited to your needs — see Item 15 above. 




MEMO 

DATE: April 15, 1971 



FROM: Phil Baker - 

suBjecT:Binet Testers for Spring ^71 



Enclosed in a list of the Binet testers we have contacted who will be 
testing in the Spring, If there are any discrepancies between this list 
and yours (for your communily) please let me know. In some communities 
the testing load is relatively light, and in others it is very heavy. 
Please contact your testers to make sure the testing can be completed in the 
time allotted; If there are problems in this area, call! (In some areas 
the time of testing has already been extended to allow for particular 
ci r cums t ances ) , ^ 





MEMO 



TO; 



Site Coordinators y Levels II and III 



OATE: 4/16/71 



FROM: 



Tor Meeland 




LOCATION. 



SUBJECT: Additional Directions for 
Spring Testing 



CC: 



HS-207 



!• Testing sequence of classes 

Last fall we specified for each community whether PV or comparison 
classes should be tested first. Since the class observation procedure this 
spring calls for alternating between PV and comparison classes, it is pre-" 
ferable for the testing to follow the seme system, i.e., if a comparison 
class is done first, then test a PV class next and back to a comparison, etc. 

Testing space or local condition may prevent this alternating scheme, 
and you will then have to modify the plan. To the extent possible, please 
alternate the classes* 

2. Classroom Information Form (GIF) 

In our effort to keep item 14 of the Fall 1970 form (family income 
level) as impersonal as possible , the instructions asked for family income 
only to the nearest thousand dollars* Subsequent analyses have shown the 
need to obtain family income data to the nearest hundred dollars* 

On the print-out form of the GIF information that we sent to you this 
spring, the family income variable for Fall 1970 is Identified as number 
(17)* Please update these figures to the nearest hundred dollars. 

Also, the new variable for present family income, number (24), should 
be filled in to the nearest hundred dollars* 

3* Testing non-English speaking children 

If a child does not understand English sufficiently well to take 
the test, please administer the test in his or her language* If none of 
your testers speak the language of the child, then the test cannot be given* 
The translation, if given, will have to be done **live" since we presently do 
not have translated tests available* This procedure is certainly not 
completely satisfactory. In any event, if non-English is used, be sure to 
enter this fact in the Tester's Log (and for safety, write "Test given in 
" on the test forms)* 



4* Invoice instructions 

Enclosed is a copy of hints and instructions for completing invoices 
that was used at the Classroom Observation training sessions along with the 
3/29/71 memo on invoices (which you should have received). Please be sure 
the testers provide all the information asked for to avoid business office 
delays and rejections* 
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5. Questionnaire Coordination with Head Start Directors 

Please give a copy of the Teacher Questionnaire and the Aide/Assistant 
Questionnaire to the Head Start Director for review and comment. The Head 
Start Director will probably wish to coordinate with the PAC chairman. In 
a previous memo to the Head Start Director, I asked them to examine the 
questionnaires and if they felt uneasy about any item/ they should contact 
me to arrange for any changes that can be made. 

Our own internal reviews and outside coordination with OCD, sponsors 
and Head Start consultants took longer than expected and is the reason we 
were unable to send the questionnaire to the Head Start Directors earlier. 
Your delivering them personally will save some time. 

A Spanish version of the Aide/Assistant Questionnaire is being sent 
only to those communities that have Ife^lcan -American or Puerto Rlcan children. 
If the Aides in these communities feel more comfortable with the Spanish 
version^ they are to use it. 

6. For Level III Sites only 

a. Training stipend for 8"Block Trainer 

As noted on the invoice instruction sheet enclosed » the 8-Block 
Trainer will receive a stipend of $20 for the time she is instructed 
by the 8-Block Observer. 

b. Mothers* stipend 

An advance has been sent to you to cover the. stipends to be paid 
the mothers who participate in the 8-Block and complete the Parent 
Questionnaire. The stipend ($5) should be given to the mother when 
she has completed the two tasks. The mothers must sign the Stipend/ 
Hbnorarium Record which serves as the receipt. Be sure to return the 
Stipend/Honorarium Record* 

It is probably most practical to have the 8-Block Trainer distri- 
bute the stipends. 

c. Parent Questionnaire 

The Parent Questionnaires are being sent to you air mail. As 
with the Teacher and Aide Quest ionnaires, please give a copy of the 
Parent Questionnaire to the Head Start Director for review. 

A Spanish version is being sent to those communities that have 
Mexican-American and Puerto Rican children for use with the mothers 
who read and understand Spanish better than English. 

When the Questionnaires are all completed » retuxti them to SRI 
in the test kits, if there is room. If they do not fit in, use the 
large mailing envelopes that we included with the questionnaires and 
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return it JgggjatfiXfiiLJlallg The envelope is preaddressed, but not 
stamped. Pay the postage and enter the amount on your invoice for 
reimbursement. 

d. ^Binet Testers 

The names of the Binet Testers Phil Baker has contacted are shown 
in the enclosed memo from him. 

Finally, I hope these additions to the testing procedures come in time 
for easy implementation. Again, should you have questions, call the person 
who seems most likely to have the answer as shown in the memo of 4/7/71. 
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INSTRUCTIONS FOR COMPLETING HEAD START INVOICES 



GENERAL 

1. Be sure to Include your: 

NAME 
ADDRESS 
HC NUMBER 

2. Each cuite. ceulej , and city must be recorded in the record of activity 
box. If t))ep.9 are not listed separately (e.g. NEVER write 11/8/70- 
12/4/70: 4 days of class observation), your invoice will be returned. 

3. All expenses must be listed in the explanation of expenses box according 

to the directions on the reverse side of the invoice. (See sample invoice). 

Please be sure to include your signature and your site coordinator's signature. 

4. You will note that your reimbursement is for the gross amount earned for 
your services. The Institute does not withhold income or other taxes and 
for this reason you will not receive a W-2 form at the end of the year. 

STIPENDS AND TESTING RATES 

1. New Observers receive: 

a. $50.00 class observation training stipend 

b. $25.00 home study stipend 

c. $20.00 training stipend if they are trained for the 8- Block Sort Task. 

2. Observers who are retrained receive: 

a. $20.00 class observation retraining stipend 

b. $20.00 training stipend if they are trained for the 8-Block Sort Task. 

3. Observers receive $15.00 per day for Head Start classroom observation.' 

4. For training trainer to give the 8-Blodc Sort Task, observer and trainer 
each receive $20.00. 

5. Giving and observing the 8 Block Sort Task; $3.00 per task for both trainer 
and observer. 

TRAINING SESSION INVOICE 

1. Include yout receipt for transportation (airline, bus, or train) or list 
your car mileage. Also include any unused tickets. 

2. Keep track of all other traveling expenses such as taxis, subways, buses. 

3. SRI will pay for your hotel room; however, your meals should be handled 
on a cash basis for which you will be reimbursed. The daily limit can 
not exceed $12.50. 

4. Please explain your miscellaneous charges on the invoice and include 
receipts if possible 



(PASSED OUT AT SPRING '71 CLASSROOM OBSERVATION TRAINING SESSIONS) 
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^^^^Zi mO/ 0 INVOICE FOR SERVICES 

^^^nrirLcJ^^OLLoyN through 



rO; STANFORD RESEARCH INSTITUTE 
MENLO HARK. C:ALIF0RNIA. 94025 



AND HEAD START EVALUATIONS 

MASB PRINT 



ROM: Name 
Address 



/ /Wr 



For Services Rendered froi 



(As shown on Purcfiastf Letter) 



— — _ hours ^ hour ( ) 

OlT days at $ ^ per day t^-K 

test ( ) 



VER/FIED BY 
APPROVED BY 



fOB $m U$e ONLY 
' Site Coofdinutor or Field Supi 



Supervisor 



CHARGE PROJECT No.. 



I Th« antire amount shown on this Expanse Claim should ba 
i chafgad against any outstanding balance. 



. hours 
days 
tests 

Total Salary 



Expenses 

(E;(pl8ined below) 
Total 



SUBMITTED BYf 




Signature 



' date^ 



RECORD OF ACTIVITIES AND EXPLANATION OF EXPENSES. Ste Instructiom on fW9ne tid0 of form. 



^ENTERS OR SCHOOL AND GRADE 
ilTY 

ASK DESCRIPTION 
See Note 1 on reverse) 

)ATE 



<0. OF HOURS./I^Y^OR TESTS 
Circle one) V—*-^ 

. TRAVEL 

8. Car at 10^ per mile 

Taxi (over SB/day show 
location visited) 
c Other 

Isee Note 2 on reverie) 

. HOTEL 

. MEALS 

. TELEPHONE 
(see Note 3 on reverse) 

MISCELLANEOUS 
Explain on reverse) 

TOTAL 
TAXI 











— ^ 










^ J — 


Co, 


C a. 


C. cf 










7 




4^ 






/ 


/ 


/ 


/ 










TOTAL 
































































































6 e 






















.60 




/^^ 






^ 6. 0 



Date 


From - To 


Amount 








I 
1 






I 



















TELEPHONE 



ERIC 



Date 


Person called ~ Location 


Amount 
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TO: 



Site Coordinators, Level I 



DATE: 



4/16/71 



FROM 



. Tor Meeiland 




LOCATION: 



SUBJECT: Classroom Information Form (GIF) and Questionnaires cc: 

REF: HS-215 



1. Classroom Information Form (GIF) 

In our effort to keep Item 14 of the Fall 1970 form (family Income 
level) as impersonal as possible, the Instructions asked for family 
Income only to the nearest thousand dollars. Subsequent analyses 
have shown the need to obtain family Income data to the nearest 
hundred dollars. 

On the print-out form of the GIF Information that we sent 
to you this spring, the family income variable for Fall 1970 is 
identified as number (17). Please update these figures to the 
nearest hundred dollars. 

Alsoi th*e new variable for present family income, number (24), 
should be filled in to the nearest hundred dollars. 

2. Questionnaire Coordination with Heed Start Directors 

Please give a copy of the Teacher Questionnaire and the Aide/ 
Assistant Questionnaire to the Head Start Director for review and 
comment. The Head Start Director will probably wish to coordinate 
with the PAG chairman. In a previous memo to the Head Start Director, 
I asked them to examine the questionnaires and if they felt uneasy 
about any item they should contact me to arrange for any changes 
that can be made. 

Our own internal reviews and outside coordination with OCD, 
sponsors and Head Start consultants took longer than expected 
and is the reason we were unable to send the questionnaire to the 
Head Start Directors earlier. Your delivering them personally 
will save some time. 

A Spanish version of the Aide/Assistant Questionnaire is being 
sent only to those communities that have Mexican-American or Puerto 
Rican children. If the Aides in these communities feel more comfort- 
able with the Spanish version, they are to use it. 
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MEMO 



TO; 



Head Start Planned Variation Sponsors 



DATE: 



7/26/71 



SUBJECT 



PROM; 




Rcf: HS-283 



CC: 



LOCATION: 



Please complete the enclosed form which concerns selected 
aspects of program implementation issues. The items are closely 
related to those in the Site Reports filled out by the OCD 
consultants. 

Return the completed form to me as soon as you can. A 
return envelope is included. 
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Appendix E 
FALL 1971 COMMUNICATIONS 
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Appendix E 

FALL 1971 COMMUNICATIONS 
CONTENTS 



Date 
8 Jul 71 

♦13 Aug 71 
1 

*18 Aug 71 

♦20 Aug 71 
♦23 Aug 71 

*24 Aug 71 
27 Aug 71 

♦27 Aug 71 
31 Aug 71 

Aug 71 

* 1 Sep 71 

* 2 Sep 71 

2 Sep 71 



To 

HSDSy Level 
III 

HSDs 



SCs 



HSDs, 
Level I 

SCs 



SCs 
SCs 

HSPV Spons 
OCD 

Testers 
SCs/Testers 



HS Traveling 
Staff 



SCs 



^ Subject 

Meeting in Menlo Park 
July 28-29 

Follow up of Head Start Dir. 
Meeting at SRI July 28-29, 1971 

Change in the Supplementary 
Test Battery and Alteration 
in the Pay Busis for the Testers 

Fall 71 Data Collection for HS 
Platmed Variation, Level I Sites 

Restatement of items from the 
Site Coordinators* meeting at 
Menlo Park, Aug. 2-6, 1971 

Shipping Materials 

^Training Session in Baltimore 
September 8-10 

Fall 1971 Evaluation Plans 

OCD Permission for SRI to 
Coordinate with Control Communities 
Huntsville and San Francisco 

Tester Affidavit of Confident- 
iality of Data 

General Instructions for Fall 
Head Start Testing 

Some Questions Which May Be 
Raised in Your Meetings with 
Community Persons 

PIF Records on **Record of 
Children Tested" 



E-0 



E-10 



E-13 



E-15 



E-31 



E-32 



E-39 



E-41 



E-46 



E-3 



er|c 



CONTENTS (Concluded) 

Date To Subject 

♦ 2 Sep 71 OCD & Huron Fall Site Visits 

*29 Sep 71 SCs Schaefer Behavior Inventory 
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MEMO 

vo; Head Start Directors date August 13, 1971 

FROM: Tor Heeland location; 

SLBjECT:Follow Up of Head Start Directors meeting at SRI cc: 
July 28-29, 1971. 




Everyone on the Project Team wishes to convey a thank you for the time 
and effort you expended to come to the meeting Ji iy 28-29, 1871 at SRI. We 
found it to be a remarkably productive session ina&;;iuch as a great deal of 
guidance was given us toward the resolution of various test implementation 
issues for this coming year. 

We all hope that the concentrated two days left t;ach of you with a clear 
(at least a clearer) understanding of the myriad details of the Planned 
Variation Evaluation. 



Enclosed is a listing of the items of information we will need on each 
child at the very beginning of the year. Although these items will be 
printed in the classroom Information form to be sent to each Site Coordinator, 
the list is sent now because you all seemed to prefer to get an early look 
at the items in order to simplify your record keeping. 

Also enclosed is a current specification of the PV classes available, 
PV classes to be tested and comparison classes to be tested « (green table) 
The changes from our earlier listing reflect the updating you provided us 
at the meeting. We will inform the Site Coordinators later about which 
classes to test (if there is an excess available). 

Last week, Aug. 2-6, the level ITI Site Coodinators attended a training 
session at SRI. It was a particularly profitable session .following as it 
did the meeting with all you Directors. Our Site Coodinators felt that the 
Head Start Directors meeting and exchanges would greatly simplify the 
evaluation work. 

Following the Site Coodinator*s meet in a change in the test battery 
was made: The Sigel Object Categorizing Test is dropped from the Fall 
Test battery. This reduces the testing time by fifteen minutes ~ whi6h 
is good, but causes a difficulty in the administration of pay rates for tests 
given. We now plan to pay the Basic Battery Testers and Supplemental Battery 
Testers on an hourly basis rather than per chiXd completed. Both the Site 
Coordinators and jrourselves seemed to prefer tnis arrangement, but I held 
out for "piece work" (with its troubles) in order to keep a tighte^r con- 
trol on testing costs. The new pay procedures which 1*11 send to the 
Site Coordinators provides certain upper time limits which should prevent 
excessive cost overuns. 



The Start Dates for Fall *71 testing are shown in the enclosed table 
(white) and are based on your estimates of opening day. Someone from the 
SRI project team will appear in each community at the start of testinicr to 
help the Site Coordinator in any way possible. Arranging economical travel 
routings for this supervising effort is a bit complicated; when the schedule 
is completed, we will let you know the names and dates. 
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Trainin*^ sessions for the 8-Block Observers will be held at SRI 
Aug. 17-19 and Aug 31-Sept 2. A third session (probably in Atlanta) will 
occur Sept 8-10# This is just information since the Site Coordintor will 
schedule the local details. 

I hope you have received youi- copy of the group picture tairon at SRI. 
It was given to the Site Coordinators at the end of their training week to 
deliver ^o you personally and provide an opportunity for an early meeting 
between you. 

The addresses of the Directors and Site Ck>odinators are contained in 
the enclosed roster. 

Again, our thanks for coming to SRI and if anything remains unclear, 
please call me at (415) 326-6200| Ext. 2682. 

Sincerely, 




Tor Meeland 

TM:cw 

Enclosures: Items to be used in the Classroom Information Fbrm 
Number of classes to be tested 
Start Dates for Fall V71 testing 

Mailing list of Head Start Directors and Site Coordinators 



ITEMS FOR THE CLASSROMI INFORMATION FORMt 1971 



Comment or Categories 



1. Name of Child 

2. Birthdate 

3. Sex 

4. Did the child have previous preschool experience? 
If 'Ves'\ was it Head Start? 

If'^Head Start'\ number of months^ 

5. Date child entered this Head Start Class 

6. Date child entered this Head Start Program 

7. Language spoken in the home: 

a. First language 

b. Secaid language 



I 



Usually this is the date of the 
first day of class 
Month and year 

Spanish or English or other 
(specify) 



8. Ethnic group of the child: 

CaucasianHiexican/Spanish*-American 

Puerto Rican 

Other 

Negro/black 
American Indian 
Oriental 

Other non-Caucasian (Specify) 
Unknown 



9. How many persons in the household are; 

a. Under 18 years 

b. 18 years and over 

10. Number of other children in the household: 

a. Now in Head Start 

b. Now in Follow Through, were in H.S. 

c. Now in Follow Through, were not in H.S. 

11. Does family receive Public Financial Assistance? 



12. Total family cash income 

13. Head of the Household 

a. Sex 

b. Employment Status 



c. Occupation 

d. Education 

14. Spouse of head of tbe household: 

a. Sex 

b. Bmployment Status 

c. Occupation (Specify) 

d. Bdueation 
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2fi 



to nearest hundred dollars 



Full time(35 hrs. or more a wk. ) 
Part timedess than 35 hr. a wk.) 
Unemployed 
Seasonal 

Write in actual Job 
Grade completed 



see item 13 
Grade completed 



DATE 



WORKSHEET 
8/13 /71 



1971-72 


M 4) 
(0 > 

e q> 


e 

M e 

(8 CO 


Classes 
to be 
Tested 












PV 


Cp 


fimnlcht 




1 Buzzaio . 


I 


12 








An f\A 


Duluth 


III 


8 


6 




"'*'"' * '■ " ■-. ** 


Q2m 09 


Oal ^ Y air A 




6 


6 

6 


02. 13 


I BCOmB 


Ill 


7 


lucson 


03» 0( 


ijBjrayefc te 




6 


6 

s 




*"**"""'■* ' ' - ■ . . ^ . . , • . . 


03.09 


ijaKewoou 




8 


03. 16 


ijxncoxn 


III 


6 


J 






03. 


ues MoineavrTj 


III 


0 




8 


.. 


Bank 
Street 


05.01 


oouxcier 


"T 


4 








f\ mm m 

05* 10 


TuBKesee 


iki 


13 


6 




.... . . 


05 • 11 


II iiminffton 


III 


10-12 


_ 6 
6 






UO» 12 


AXmira 


III 


6 






Becker k 
nann 


07* 11 


1^<v%a1 M 

Xiipexo 


III 


6 


6 


4 






&• JUaBVoKaSf MM 


III 


5 










w» XiasveBas » jw 


III 


0 




A 




07. 


frovxaenceif^ j 


III 


0 




fl 
O 






08. 02 




I 


7 








Oo» 04 


i^rbBsevxxxe 


III 


4 


A 


A 

'm 




Oo, Of 


NOUnuB. XXX* 


III 


• T ■ 


w 


9 

A 






U9» U2 


ITwvlfBXbOIl dCu 


III 


& 


5 






09.04 


weiibrax uzbtkb 


III 


16 








09.06 


ureexey 


III 


l" 








no in 


Seattle 


I 


6 






■■ . . »^ 


Gordon 


lO. Ol 


jBckBonvllle 


I 


3 








lO. oz 


.TAffiAflhAvn 


III 


3 


— J 


""3 ■ 




10.07 


wnw I ■nooBa 


III 


10 


— ? 
S 


4 


\ : \ — 


10. 10 




TTT 


O 


4 




BDC 


11.05 


WaahlUKton 


I 


5 








11.06 


Paterson 


III 


4 


4 

6 


4 




11.08 


Johnston Co. 


III 


6 




Pitts- 
lurch 


12.03 


Lock Hsvsn 


III 


7 
3 


JB 
3 






12. 04 


Montevideo 


III 






tEC 


20.01 


Kansas City 


III 


8 


6 


5 




I-Y-D. 


26.01 


St. Ttkmas.Vl 


X 










Bnablcrs 


27.04 


Bllllnn 


HI 










27.05 


Colorado Sp 


III 


6 


_6 

8 






27.03 


Bellows Falls 


III 


6 






27.02 


Newbursh 


III 


8 


6 






.27,, 01 


Puerto Rlcfji 
















T 


, 6 








CD 




HUntsvllle.Ala 


III 










CD 




SanFranolseo 


III 





Level I « 9 
Level III m 32 



TOTALS 



248 



152 56 
(=22) 
81 



ERIC 



)ATE 



WORKSHEET 1 

8/13/71 
Head Start Communities 

1971-72 



)NSOR 



inlcht 



02>Q2 
02iP4) 



:son 



L 



Ik 

reet 



sker & 

5le- 

in 



bhell 



Ikart 



rdon 



CODE 



02*09 



02, 13 
03.08 



03.09 



03.ftg 



03. 



05701 



community' 



M 0) 
(0 > 
0) \ 



Buffalo 



Duluth 



Salt Lake 



Tacoma 



LaFayette 



Lakewood 



Lincoln 



Pes Moines (FT) 



Boulder 



Tuskegee 



05. IP 

05J 

05.1^1 Elmira 



Wilmington 



07 
07.14 



07. 



Tupelo 



E. Las Vegas, NM 



W. Las Vegas, NM 



Jgrov Idence ( FT) 



Oraibl 



08.02 

08f04i Portagevllle 



08.08 



09^02 



Moundi 



111, 



Ft. Walton Bch 



Central Ozarks 



09. Q4 
09.101 Seattle 



Greeley 



10.01 



Jacksonville 




Jonesboro 



Chattanooga 



Houston 



ll.OSj Washington 



Paterson 



Johnston Co> 



Lock Haven 



Montevideo 



Kansas City 



St> Thomas I VI 



27.04 Billings 



27iDSl Colorado Sp 



Bellows Falls 



Newburgh 



Puerto Rico 



San Jose 



HUnt8vllle,Ala 



SanFrancisco 



II] 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



III 



Tested 
Classes 



PV 



C£, 



30 3 



\ 



7- » Tt^m- arm^TS 

0» ifML dau^ Ci/«5gS 



6 



8 



=2 



dO 



A2 



\4- g 



ERIC 



A6»yy / ISar?/^ /^aP as v3 uf00A<S ^/if^^ 

'-Ikieuesr i^effjrJs o^joatx. ti^/S- 
U^t¥, »P/tftt omi^p ^or 3/ w JMVi/Af erQM em ^to£, . 
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STANFORD RESEARCH INSTITUTE 

MENLO PARK. CALIFORNIA 94025 
(415) 326-6200 



Aug. 18,1971 



To: Site Coordinators 

Subject: Change in the Supplementary Test Battery 
and alteration in the Pay Ba^sis for the 
tes ter s • 

HS-300 

Change in the Supplementary Test Battery 

The Sigel object categorizing Test has been dropped from the Supplementary 
Test Battery for Fall 1971. It will be used next spring only. For the effec- 
tive administration of the Sigel, additional clarification of procedures and fur- 
ther instructions are needed and there is not time to do this. 

This deletion alters the pay rate for the Supplementary Tester as described 
below. 

Change in Pay for Testers 

The elimination of the Sigel from the Supplementary Test Battery required 
a change in the pay rate for each child tested. Ibgether with the awkwardness 
that could occur with the splitting of the Brown into a separately paid ac- 
tivity and the general inclination of the Site Coordinators to use an hourly 
pay rate, the new Pay Schedule established for the Basic and Supplementary 
Testers will be $3.50 per hour. 

The p^ rates for childi'-en tested that was given to you at the Site Coor- 
dinators meeting was based on an expected hourly rate of $3.50 for Basic Battery 
Testers and $3.85 for Supplementaiy Battery Testers. Hie complexity and demands 
of the Sigel Justified this differential. Now that the Sigel is dropped, 
the hourly rate should be the same. 

The hourly rate was extablished with the expectation that the following 
testing load was reasonable and expected: 

V 

Test Time to co]q)lete Expected 

one child Number of children 
tested in 1 hour 

Basic Battery 40 mJ.nutes li 

(PPVT, WHAT, PSI) 

^'rown 12 minutes 5 

Siq>plenentary Battery 30 minutes 2 

(Bnumeration, ITPQ, Motor 

Inhibition) 

From these figures you can closely estimate how maigr hours a tester would 
wrk. For examplBflf a conmunity had a total of 6 classes to test and 17 
children per class, there would be 17 x 6 = 102 children. The Basic Batteiy 



would require 102 f s 68 hoiirs of testing (by each of two testers working 
34 hours) ; the Brown would require 102 r 5 » 21 hours of testing and the 
Supplementary Battery (6 children per class = 36) would require 36 ^ 2 s 18 
hours of testing. 

To aid you in your planning, the following table may help you: 

Number of children Number of testing hours needed Supplementary Battery* 
to be tested (1/3 of each class, but 





Basic Battery 


Brown 


mln.of 6 ] 


45 


30 


9 


7i 


60 


40 


12 


10 


75 


50 


15 


12i 


90 


60 


18 


15 


105 


70 


21 


17i 


120 


80 


24 


20 


135 


90 


27 


22i 


150 


100 


30 


25 


165 


110 


33 


27i 


180 


120 


36 


30 



per class) 



* 3 hrs. per class if 
6 children tested per 
class . 

ExBsaplez 

If 2} hrs. per dsQr are available for testing , plan on 2^ x 14 day = 35 hrs. 
available in the three week test period for any one tester. Thus if you have 
105 children, it will require 2 Basic Testers (35 hours each) , and one Supple- 
mental Tester who can also do the Brown (17^ hrs. -f 21 hrs. = 37} hrs.). Al- 
thoui^ the 37} hours may spill over to the first day of the next week, this is 
better than using an additional tester which adds training costs and reduces 
^^the testers* total incone. The Brown tests could be given in between Supple- 
mentary I\e8t8 to make efficient use of the tester's tine. 

Attached is a revised pay schedule. Notice, the 8- Block observer and 
trainer are still paid $3.20 per child/Uother completed > 
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HEAD START PLANNED VARIATION EVALUATION . ^ ^ 

TESTING PAYMENT SCHEDULE, FALL, 1971 ^^'l^'^l 

Home Training 
Study 

Stipend Days Stipend Testing Payment 



Clerical Assistant to Site 
Coordinator 



Basic Battery Testers 



"Brown" Testers 



Supplementary Battery Testers 



8-Block Sort Observer 



8- Block Sort Observer 
Training the Trainer 

8-Block trainer 



$15.00 



$15.00 



2 
2 



Class Observers 



$25.00 7 



$40.00 

$20.00 

$40.00 

$60.00 

$40.00 
$40.00 

$95.00 



$2.20 per hr.(Max- 
imim of 8 hrs. per 
day and 5 weeks) 

$3,50 per hr, (aver- 
age of 1^ children 
per hour) 

$3.50 per hr. (aver- 
age of 5 children 
per hour) 

$3.50 per hr, (aver- 
age of 2 children 
per hour) 

$3.20 per Mother/ 
child 



$3.20 per Mother/ 
child (including 
Parent Information 
Form) 

$18.00 per class 
day 



Honoraria: 



Anoimt 



Activity 



Mothers 



$5.00 



Participation in 8-Block Sort 
($3.00) and co8«>letion of Parent 
Information Form ($2.00) 



Teachers 



$20.00 



Completed Classroom Information 
Form by second week and Schafer 
Ratings of children (during 7th 



$10.00 



Tsacher Info: 
April) 



tion Fdrm (daring 




STANFORD RESEARCH INSTITUTE 

MENLO PARK. CALIFORNIA 94025 
(41^1 326-6200 

To: Level I Head Start Directors 
From: Tor Meeland 



Date: August 20,1971 



Subject: Fall *71 Data Collection for HS Planned Variation, 
Level I Sites 

I wish to confirm the information Becky Simons conveyed to you by 
phone • 



A. The data collection activities for the Level I Sites in the HS 
Planned Variation Evaluation for 1971-72 include the following: 

Fall *71 Classroom Information Form, This form provides 
a summary of family and background information on each 
child in the class ^ The items of information needed 
are similar to the ones used last year^, but a few items 
have been deleted to shorten the form. 

Ratings of the Children by the Teachers (Schaefer Behavior 
Inventory) This rating form of 16 items is to be completed 
toy the PV teacher for each child in her class. It should 
be done during the seventh week of class; this allows 
tine for the teacher to become familiar with each child. 

Teacher Information Form. This form is similar, but 
shorter than the Teacher (hiestionnaire used last year. 
It is to be completed in the early spring. 

B. The Payment of Stipends to the Teachers. 

A stipend of $20.00 will be paid each PV teacher for completing 
the Classroom Information Form (by the end of the second week of class) 
and the Schaefer Behavior Inventory (in the 7th week) 

A stipend of $10.00 will be paid each PV teacher for Completing 
the Teacher Information Form in the early spring of '72. 

A stipend of $20.00 will toe paid each PV teacher for completing 
those items in the Glassroom Information Form that can not be done 
until a week or two before the end of classes next spring (data for 
new children 9 days absent » etc.) and again completing the Schaefer 
B^avior Inventory. 



C. 



Payment of Stipend (thru the Sponsoring Agency) for support of 
data collection by the HS Director's Office. 



In consideration of the coordination effort and support that the 
HS Director and office most giwe for the accurate and timely coqile* 
tiott of the abowe described activities^ a stipend amounting to $30.00 
for each PV clmms will be paid to the CAA or appropriately named spon- 
soring agency. It is envisioned that this ^^^^J^ ^'^^ eiiample $180.00 



for 6 PV classes) could be used to compensate for increased work loads ^ 
or the use of additional support personnel or the purchase of materials 
and equipment for the program • 

The full stipend would be paid upon receipt of the completed CIF*s 
and Schaefer forms this fall. 

Enclosed are sufficent copies of the Classroom Information Form 
and instruction sheets for each PV class in your community, 

Jt may be useful to distribute the CIF*8 to the teachers prior 
to registration in order to expedite the completion of the forms. 

At the end of the second week of class, please return the com- 
pleted CIF's to me in the envelope provided. Be sure to send the 
package REGISTERED MAIL; the cost of the mailing will be reimbursed 
along with the $30,00 per class stipend, 

E, In order to maintain our standard procedures for the administra- 
tion of the Schaefer Bd&avior Inventory, the forms will be sent %o 
you during the last week of September or the fifth week of class-- 
which ever occurs later. Please return these Schaefer Behavior In- 
ventory Forms to me by REGISTERED MAIL; again, the cost of mailing 
will be reimbursed, 

F, Thank you in advance for your efforts, I am particularly pleased 
that the class stipend, as modest as It is, can be provided you for 
ycur own use. If you have any questions, please call collect to 
Becky Simon or myself at (415) 326-6200, 



Tor Meeland, Ph.D. 




Sr. Research Psydiologlst 
Project Leader, Head Start 
Planned Yariation Evaluation 
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MEMO 



TO: 



Site Coordinators 



DATE: 



August 23, 1971 



FROM: 



Tor Heel and 



LOCATION: 



subject: Restatement of items from the Site Coordinators* 
meeting at Menlo Park^ August 2-6^ 1971 



CC: 



HS-303 



The following comments are reminders of salient decisions and 
procedures that were covered at the Site Coordinators* meeting. 
They are shown here in capsule form to serve as a ready check list 
of i^)ortant things to do, 

INFORMATION FOR THE HEAD START DIRECTORS 

!• Coordination with the. Head Start Director and Teachers ^ 

It is very useful to provide each Head Start Dirtlctor with 
a schedule showing dates that each class will be tested, 
including the names of the testers who will appear. This 
not only informs the Head Start Director of your plans but 
provides a vehicle for an alert to the teachers that testing 
is atomt to begin. 

2. Test copies for the Head Start Director ^ 

At the Head Start Directors' meeting in Menlo Park at the 
end of July it was impossible to provide copies of every 
test since printing had not been completed. The missing 
items will be sent to the Head Start. Qir^tors directly 
from SRI. 



3. SRI meetings with Head Start Directors and teachers, prior 
to pupil testing. 

Head Start Directors sbcmld be encouraged to have their 
teachers and other apprc^riate persons attend a session with 
tbe vial ting SRI representative in your oommnnity Just prior 
to the Pall testing. At this time the various questions 
wUeh ma^ be rmimed by tte teadiers can be responded to. 
However, the decision to hold this meeting is op to the Head 
Start IlL rector. 
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Calendar of training sessions for the Head Start Planned 
Variation Evaluation , ' 

The following training sessions will be conducted fay SRI: 

Head Start Directors' meeting July 28-29 at Menlo Park 
(completed) 

Site Coordinators' meeting August 2-6 at Menlo Park 
(completed) 

8-Block training session I, August 17-19 at Menlo Park (completed) 
8-Block training session II, August 30-September 1 at 
Menlo Park 

8-Block training session III, September 8-10 In Baltimore 
Class Observer training session I, January 1972 at Menlo 
Park 

Class Observer training session II, January in Atlanta 
Class Observer training session III, (If necessary) 
early February in Atlanta, 

The 8-Block Observer who will be trained by SRI personnel 
should be the same person who will participate In the 
Class Observations to be conducted during February 1972. 
The 8-Block Observer, having completed her session at SRI, 
will return to oomntmlty and train the 8-Block Trainer, 
The 8-Block Trainer Is the person who will give the instruc- 
tions to the mother prior to the mother teaching her child 
the concepts contained in the 8-Block Sort Task. The train- 
ing of the 8-Block Trainer by the 8-Block Observer will 
occur in the lobal community prior to the Fall testing. 

Release and Scheduling Forms , 

To simplify the Ffedl testing, the following release/ 
scheduling forms are provided, to be used as needed: 

a. Parent Release Form—giving permission for the 
child to participate in the Read Start Planned 
Variation Bvaluatlon Testing, (Use only if necessaijc) 

b. Scheduling form letter for mothers participating 
in the 8-Block Sort Ttak, 

c. Tester affidavit of confidentiality of test data. 

Copies of b and c are induded for your use. If Parent 
Release Foims are needed in your oommonlty, please tell me 
how many to send you. 
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HEAD START PLANNED VARIATION EVALUATION 
PARENT RELEASE FORM 



(date) 



To: 



, Head Start Director 



(Conmunity) 



I hereby give you pemdssioii for 97 child 



(name) 



to participate in the Head Start Planned Variation Evaluation Testing 
being conducted during the school year 1971-72. It is understood 
that any data collected on aqr Child for this evaluation is confidential 
and will not be released by Stanford Research Institute (which is 
collecting the data for the Office of Child Developnent, Department of 
Health, Education and Welfare) without persission. 



(signed) 



(date) 




HEAD START PLANNED VARIATION EVALUATION 



Date 



Dear Mrs* , 

I have not been able to get in touch with you about taking part 
In the Head Start 8-Block Sort Task with your child , 
and to fill In a short Parent Information Form. You will be paid $5.00 
cash for doing this and It should take about one to one and a half hours. 

Please call me at (phone) and I can describe the 

activities to you and arrange a time more convenient for you. If 
possible I I would like you to come to: 



Location 



Day and Date 



Time 



Approved : 



Head Start Director 



Tester for 
Stanford Research Institute 
Head Start 
Planned Variation Evaluation 



ERIC 
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HEAD START PLANNED VARIATION EVALUATION 
TESTER AFFIDAVIT OF CONFIDENTIALITY O^ DATA 



I understand that the data collected for the Head Start Planned 
Variation Evaluation conducted by Stanford Research Institute is 
confidential in nature and I will not disseminate any portion of the 
test materials or data to any persons other than SRI without the 
express permission of the Head Start Director, 



(signed) 



(date) 



(comnunity) 
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TESTING MATTERS 



6. Testing Space , 

Three weeks before the first day of pupil testing and 
following coordination with the Head Start Director you 
should attempt to identify the availability of testing 
space at each Head Start Center. Considering how mai^ 
testers (Basic, Supplementary and 8-Block) that will be 
involved in your community, it is critical that sufficient 
testing facilities be available. If there is no room in 
which to test, please consider the use of trailers. The 
first preference is to get a VW Micro bus camper or similar 
vehicle made by Ford or Chevrolet, etc. which may be avail- 
able from a local rental agenpy or car dealer. A second 
preference is to use a vehicle that belongs to yourself or 
une of the testers. If additional testing space is made 
by yoU| please contact Chuck McCarty at SRI before formal 
committments are made in order that details concerning the 
rental rate agreement and insurance coverages can be discussed. 

The problem of testing space was raised with the Head Start 
Directors in the meeting at Menlo Parte and a reminder note 
was sent to them for their support in locating adequate 
testing space. 

Criteria for selecting testing space ; 

A. There must be adequate lighting, heat/cooling and 
ventilation. 

B. Distracting noises and activities must be kept to 
a minimum. 

C. Traffic psjit terns must be such that there is no 
disturbance by the movement of other persons thru 
the test area. 

D. Finally, the critical issue is to make sure that 
the testing conditions provide the opportunity for 
the child to perform to his maximum. 

7. Procedures for hiring of testers . 

Hie responsibility for hiring all testers and observers rests 
on the Site Coordinator, but it is imperative that the Head 
Start Director be informed of each person who is identified 
as a potential tester; the Head Start Directox% approval of 
this peirson is most important. During your early coordination 
meeting with the Head Sta^t Director « you will probably re* 
ceive some useful suggestions for tester personnel. IVsster 
application forms (yellow) ar6 enclosed in your Site Coordinator's 
Kit« Please send these to Janny Brust at SRI as soon as you 
have hired each tester; the forms are necessary to prepare 
the payment arrangements with each tester. The tester 

affidavit forms should also be returned to Janny Brust along 

with the application forms. 
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8. Rehiring of testers from Spring 1971 > ^'^ 

I 

It is most desirable to rehire testers that performed well % 

last Spring. In a few instances we have identified testers | 

whose material indicates that they are inadequate, incapable f 

or short of desirable tester characteristics and should not ^ 

be rehired this Fall. If this is the case, we will have ^ 
contacted you personally no later than August 25, 1971, 

9, Guidelines for conducting your tester training sessions > 

Attached is a restatement of procedures for testers to 
follow. in the implementation of the various tests (green 
pages). They are consistent with the guidance given in 
the Follow Through Evaluation program, but have been modified 
to suit the particular circumstances of the Planned 
Variation Evaluation. 

10. Use of non English language in the test administration . 

If it is necessary to use non-English in order to instruct 
the child in the task he is to perform, this is acceptable. 
However, the test items themselves must be given in English 
and the child *s answers should be given in English. If the 
the child responds in Spanish, French, Portuguese, Indian, etc., 
he should be reminded to answer in English. If he does not, 
the item is to be scored and a note made in the Tester ^s Log 
of the foreign language response . 

11. 8-Block Administration to mothers with two children . 

If the random permutations applied to any given class results 

in the inclusion of two children from the same family in the 

1/3 of the class which is to receive the 8-Block Sort, only 

the first of the two children identified is to be tested 

with his (or her) mother and a replacement should be made ' 

by using the next child in the list you prepared to show | 

the order children are to be tested. Also make this change 

for children getting the Supplementary Battery. 

12. Classes to be tested in the Fall 1971 testing program . 

There are several considerations for the designation of 
which classes are to be tested in the community. Of 
primary importance is the need to include those teachers 
whose classes were tested last year. In those communities 
where there are morie than four PV or Comparison classes to 
be tested, it is desirable to include those teachers who 
have had the longest time in the Sponsor *s program. 
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In the event the teacher has left the community , the same 
classroom should be tested Inasmuch as there is a fairly 
high probability that the aides would have been present 
last year and thus represent a degree of continuity* If 
there are six or fewer PV classes, test each class. In 
those communities with more than six PV classes, SRI will 
select the cla^aes to be tested in coordination with the 
Head Start Director. 

The GIF and Schaefer B^avior Inventory are to be given in 
all PV classes (including those PV classes that are not 
tested) and in all comparison classes that are tested. 
For example, in Chattanooga there are 6 PV and 4 comparison 
clas5^es to be tested, but the GIF and Schaefer will be 
given in all 10 PV classes plus the 4 comparison classes. 

13. Order of tests in the Basic and Supplementary Batteries . 

The tests in the Basic Battery should be given in the 
following order: 

a. Peabody Picture Vocabulary Test 

b. Wide-Range Achievement Test 

c. Pre-School InVentory 

The Brown Self-Corcept test is given separately and 

although it is part of the Basic Battery it does not 

come in the Basic Battery sequence, necessarily. The ^ 

Supplementary jtSfittery is to be given in the following order: 

a . Enumerat ion 

b. Illinois Test of Psycholinguistic Ability (ITPA) 

c. Motor Inhibition Test 

The 8-Block Sort, although part of the test battery, is 
considered a separate event for purposes of administration 
and is given according to the availability of mothers. If 
a mother/child appointment is missed, try for one (1) make- 
up session; if this fails use next child in your order of 
testing and try to coordinate with the Supplementary Battery 
Tester. 

14. Random Permutations for classes of more than 30 children . 

If any of your classes have more than 30 childr«fn, call me 
for the random permutation blocks that you will need. 
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15. 



Tester responsibilities. 



The testers must make use of the Tester's Log to note any 
variations In test administration, record their Judgements 
as to the adequacies of the testing conditions, and In these 
cases to make an appraisal as to whether or not any particular 
test or subtest should not be Included In our data processing. 
These records are critical to the successful ooiqiletlon of 
the Planned Variation Evaluation. The Tester's Log requires 
that the tester be extremely self-crl tlcal and this In Itself 
presents a problem because no tester wishes to admit errors 
In his test administration, and yet It Is quite unlikely 
that any tester can administer a test to 45 children without 
some variations occuring. Please licpress on the testers 
that no penalties can or will be Imposed on them because 
of entries made in the test log; in fact, a blank test log 
is a fairly good indication that the tester has not been 
critical of the tests that he has administered. Please 
admonish all of your testers to be very conscientious in 
their appraisal of the potential usefulness of the data they 
have collected. If known errors are included in the data 
processing then the value of some of the Head Start Planned 
Variation Evaluation is weakened. 

1* there are no problems in the testing , do not make entries 
in the Tester ' s Log . 

16. Tests given by Site Coordinators . 

As a basic policy, the Site Coordinators are not to admin- 
ister any test in order that they can give all their 
attention to the management and supervision and a^ordi.nation 
of the myriad details of the testing that must be iiq)l^iiient- 
ed. However, in certain circumstances, such as when a tester 
becomes ill during the day and the Site Coordinator is 
present, it may be moze convenient ( and easier for the child 
involved) for the Site Coordinator to coiqilete the test 
already started. Tbward the end of the three week testing 
' session it may prove to be more economical for the Site 
Coordinator to put In one or maybe two days of testing in 
order to co]q>lete the tests on schedule rather than to take 
the time to train a replacement tester for the one who has 
taken ill or is unavailable due to some other emergenqr* 

17. Spanish Version of the Parent Information Form . 

We have examined the PIF of last spring and were surprised 
to see that only 2 parents made use of the Spanish Version. 
Since it is simply not economical to provide a different 
version for so few mothers, no Spanish Version of the PIF 
is included In your test kits. 

If you do run into a mother who reads only Spanish, please 
have the B-Block trainer read the PIF to this mother and 
note this on the "Record of Children Tested." In addition, 
this fact should be noted in the Tester's Log. 
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18. Pay Rates for Testers ♦ 



A new schedule of pay rates for testers , and the reasons 
for changes, has been mailed to you* If you have not 
received this memo of August 18 , 1971 , please call 
Klara Evans* 

19. Shipping schedule and procedures . 

All test materials I Including test kits for the testers you 
will employ I plus a Site Coordinator's Kit which will 
Include special materials and spare formd if needed i should 
arrive three weeks prior to the beginning of your first 
test. However y because of the printing schedules and other 
restrictions, those communities which will Initiate testing 
September 8 will not receive their test kits until August 25 
or 26. 

At the time the test kits and Site Coordinators kits are 
shipped (air freight) from SRI consigned to the Site 
Coordinator at the address you provided us at the meeting 
at Menlo Park, an alert notice will be mailed to you 
indicating the date on which the shipment was made and a 
reminder that if receipt of the shipment has not been 
effected by a certain date, you are to call SRI. This will 
give us sufficient time to instigate the necessary tracking 
of the shipment and, in the event it has been lost, a replace- 
ment can be shipped. The packing lists will also be included 
in this alert letter to enable you to check the contents of 
the kits. 

Return shipment of test materials upon completion of the 
testing. 

Three weeks from the date of the first test, all materials 
including completed tests, unused forms and teat materials 
are to be repacked in the test kits and returned to SRI, 
collect, via air freight according to the instructions 
packed in the Site Coordinator^ test kit. Please remember 
there are two items you do not repack: the Class Informa- 
tion Forms which will have been returned to SRI, registered, 
at the end of the first week of testing and second, the 
Schaefer Ratings which the teachers will complete for each 
of their children during the seventh week and which you 
should mail to SRI, registered, at the end of the seventh 
week. 

.Remember to put the mailing charges on your invoices^ and 
also to mail to SRI a note that alerts us that you have 
(on a specific date) shipped the test kits back to Menlo 
Park. If we have not received the test kits by Air Freight 
within 7 days of your shipping date , we can call you in 
order to institute a search and retrieval procedure of the 
test kits.' 

E-24 



INFORMATION ABOUT FOLLOW THROUGH TESTING 



20« For your information, attached (blue page) is a listing 
of Follow Through Field Supervisors from SRI*s Follow 
Through Evaluation Porject, and the name of the Follow 
Through Director. Follow Through testing is scheduled 
for a two week period beginning in the third week of class. 
School schedules do not necessarily correspond to Head 
Start schedules. 

We have tried to keep the Follow Tlirough project informed 
about the details of the Head Start Planned Variation 
testing in order to keep any local inconveniences to a 
minimum. Since the Planned Variation program provides 
an additional year of data on children yfho progress into 
Follow nirough, it is most important to us at SRI that 
a close integration of Head Start and Follow Through 
Evaluation plans and procedures be maintained. As you will 
recall from the Site Coordinator meeting at Menlo Park, 
the selection of tests and the data collection procedures 
are intimately tied to the Follow Through project. If you 
run into any conflicts or questions about this integration 
with Follow Through, please call me. 

ADMINISTRATIVE MATTERS 

21, Information about SRI for your testers . 

Enclosed are extra copies of the SRI brochure describing 
the programs at the Institute, Please give them to your 
testers if you think it would help them understand the 
roles and scope of SRI in the world of research and service, 

22 , SRI contacts for field difficulties . 

Hie best responses to your problems can be made if you call 
the following people concerning: 

Material and Test Shortage Cindy Souza/Mlke Duf^ — ext, 2407 

Invoices and related pay problems— Janny Brust/Vicki Pear 

ext, 3038 

Basic batteiy and supplementary battery tests*~Jane Stallings/ 

Klara Evans/ Jean Lotridge-~ext, 3564, 2517, 2613. 
Class Information forms-«-Romaine Mason-*-*ext, 4840 
Rental of test space—Chuck McCarty-*-*ext, 4484 
Head Start Policy Issues—Tor Meeland— ext, 2682 
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23. Pajnnent of Stipend to Teachers. 



When the completed Classroom Information Forms have been 
received (after the first week of testing) and the completed 
Schaefer Behavior Inventory have been received (after the 
7th week of class), stipends of $20.00 will be mailed to 
each teacher. 

It is necessary for you to complete the Stipend/Honorarium 
Record for Teachers (included in your Site Coordinator's 
Test Kit) and submit these forms before the teachers can 
receive payment. 

24. Cash f.or 8-Block Mother *s Honorarium 

Prior to testing, you will receive a check for $5.00 x the 
number of mothers to be tested on the 8-Block. The 8-Block 
Observer or Tester should pay the $5.00 Honorarium to each 
mother who complets the 8-Block Sort and Parent Information 
Form. Be sure that each mother signs the receipt form 
upon receiving the Honorarium and be sure these Honorarium 
Receipt Forms are returned promptly to SRI. 

25. Summary of Critical Dates « 

Attached is a check list of events for Fall 1971. It 
summarizes the events and things you should do beginning 
three weeks prior to the start of testing throvigh the 
point when the Schaefer Behavior Inventories are returned. 

I hope this calendar of events is helpful to you and serves 
as a useful reminder of things to do. 

P.S. Here is your copy of the Site Coordinator photo made at 
the August meeting. It's an impressive group! All of us 
on the project look forward to seeing you again at the 
start of your testing. According to the schedule Klara 
Evans has laid out (and probably liable to change) we will 
each call ahead to give you warning of our comings (and 
goings). The purpose of these visits is to give assistance 
as needed; it also provides an excellent means to coordinate 
last minute changes in procedures. 
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GUIDELINES FOR TESTER TRAINING 



I. Conditions that must prevail for teF t administration 

A. Tbe test environment will include suitable furniture (including at 
least two chairs and a table or desk top for work surface), adequate 
lighting, and reasonable freedom from noise, interruptions, and other 
distracting features. It may be possible for two or more testers to 
administer tests in the same room at the same time, provided they can 
be adequately separated within the room so as not to distract each 
other. Rooms such as libraries or lunch rooms where individuals not 
associated with the testing may be passing through or stopping for 
other activities are not acceptable. 

B« All test arrangements must be coiq)leted in advance, so that local 
school personnel, including the Head Start Director and classroom 
teacher, can be adequately prepared for the SRI testing. 

C. Each child must be sufficiently prepared to cooperate with the 
tester before he is tested. Any child who is ill, diistraught, 
upset, or unmotivated to the extent that data from that child 
are misleading should not be tested at that time. Return to 
the child at a later time in the test pycle if the limiting 
conditions can be removed. Note the condition in the Tester^s Log. 

II. Conditions that invalidate data collection 

A. Lack of proper test material 

B. Inadequately trained testers. 

C. Inadequate or distracting environment, which includes lack of 
adequate furniture, poor light, noise level so high as to be 
distracting, and interruptions. 

D. Condition of the testee — poorly motivated, distracted, or ill. 

III. General Procedures for Testers 

1. The tester will adhere to prescribed testing procedures « 

2. The tester will maintain impartial attitudes, providing no extra 
hints or no addltonal coaxing and will guard against providing 
unconscious cues such as facial or hand expressions that may 
suggest the correct answer to the child. 

3. The tester will be skillful at establishing rapport with the 
children, which includes being proficient at engaging the 
child In friendly conversation before and after each test 
administration. The tester will also recognize signs of lack of 
rapport, which may be exhibited in the child's behavior as 
inattention, giving up, or fault finding. 

4. The tester will know all conditions outlined in I above and will 
administer the tests only when these conditions prevail. 

5. The tester will know all conditions outlined in II above and will not 
administer the tests under conditions that will invalidate the data. 
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6. The tester will be cognizant of the attitude of the child, with 
particular emphasis on his motivation for the test experience, and 
will not test at times when the child is anticipating some special 
privilege, such as lunch, playground, or free time. 

7. The tester will give directions simply and clearly, repeating 
the directions as stated if needed, except when the instructions 
specifically state that the directions may not be repeated* 

8* Under no circiunstances will the tester indicate even the slightest 
degree of dissatisfaction with the child's response. 

9. The tester will not attempt to Judge the child when speaking with 
adults who are part of the local Head Start program. The tester 
will not discuss the child's performance with other testers within 
hearing range of the child or adults from the local community. 
The tester will not attempt to diagnose or agree or disagree with 
a diagnosis provided by the teachers. The instruments and the training 
of the staff are not adequate, nor were they intended, to meet 
these requirements. 
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FOLLOW THROUGH PERSONNEL 



Head Start Communities 
1971-72 



SPONSOR 
Ximnicht 



02.04 



COMMUNITY 



Buffalo 



m > 



Tucson 



3ank 
Street 



3ecker & 

Sngle- 

nann 



iushell 



03.16 



Yeikart 



jordon 



IDC 




ERLC 



02.09 



02. 13 



03.08 



03.09 



03. 



05.01 



05.10 



05.11 



05. 12 



07. 11 



07.14 
If ' 



07. 



08.02 



08.04 



08.08 



09.02 



09.04 



09.06 



09. 10 



10.01 



10.02 



10.07 



10. 10 



11.05 



11.06 



11.08 



12.03 



12.04 



20.01 



26.01 



27.04 



27.05 



27.03 



27.02 



27.01 



SRI Field Supervisor 



Follow Through Director 



Duluth 



1?yederick Svkbs 



I j Phil Giesen 



Salt Lake 



Tacoma 



LaFayette 



Lakewood 



Lincoln 



Pes Moines(FT) , 



Boulder 



Tuskegee 



Wilmington 



Elmira 



Tupelo 



E. Las Vegas, NM 



W. UsVegas.NM 



Providence(FT) 



Oraibi 



Port agevi lie 



Mounds^ 111 



Ft. Walton Bch 



Central Ozarksl 



Greeley 



Seattle 



Jacksonville 



Jonesboro 



Chattanooga 



Houston 



Washington 



Paterson 



Johnston Co. 



Lock Haven 



Montevideo 



Kansas City 



St. 



Thomas ^^VI^ 



Billings 



Colorado Sp 



Bellows Falls 



Newburgh 



Puerto Rico 



Hunt8ville,Alal 



SanFrancisco 



^^louis^^ankh 



Alix McClaryj 



Al Tiiinewan 



Jav Cross 



Yolanda Jenkins- 



David Beers 



David Beers 



Ed Jackson 



Bob Campana 



Alix McCl ary, 



Ed Jackson 



Allen Brldn»fl 



41 TAinemftn 
Phil fliftflon 



-BUJIaa&IL 



Bliss Patrick Shef Cer 



Mr. Terry unurcnixx 
Mrs. Roseiia uicKson 



Mr. tiames Kooerxson 
Mrs. tsernice vIOIlfilB 



Mrn, BftatrlM Mw^irr 

Dr, Jim Sanders -f 



Mrs. Elizabeth Tkteadweli 



lirs. Inez Pitts 



Mr. Willis McLeod 



Mr. Harold Hutcnings 



Mrs. Juliet Borden 



Mrs. Margaret Aragon 



Mrs. Margaret Aragon 



Mr. Joseph Santoro 



MissMargaret Taylor 



Mr. Blaine Martin 



Mr. Leon Shumaker 



Mrs. Mary Hancocir 



Mr. Don Dunn 



Mr. Michael Resales 



Mr. Charles Wallgren 



Mrs. Alvenia Scrlven 



Mrs. Nettie Whitehead 



Mr, E. Gene Horton_ 



Mrs ^ Jerlean Webster 



Mr, Bruce Sands 



Miss Ora Piptin 



Mr. Bruce Sloan 



Mrs, Mary Ellen McGowan 



Mr. Lloyd Olsen 



Miss M. Itorris^^.Mrs. B. AisprooK 



muu Alice Miller 



Mrs. Alba Hernandez de Colon 



* To be assigned to new field staff 
+ Coordinator of testing 
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SITE 00(»DmTOR*S CHECK-LIST OF EVENTS, HEAD START PIAMNED VARIATION, FALL 1971 



Week of 

Class 



-2 



g Classes Start 



0) 

1- 



-1 



Pupil Testing 



Period 



r 

Note ; Check Testers* 
INVOICES 
each veek.lc 
M/UL TO SRI 



• Initial coordination with Head Start Director 

• Hire Testers 

• Recieve Test Kits from SRI 



• Identification of classes to be^tes 
- §^|)^^g3P5|[^|||Q$^"^®^! coorainat 



ted 

e 



• Train testers 

# Select test space 



• Schedule testers •* Begin Qdieduling Mothers fSrBlock) 

• Determine order of testing for childran 



# Final check-out of testers 



SRI Field 
^Supervisor 
I on hand 

to help 



• Return ^^Hgfg^^gi^'gl^'^^^^ Forms 



-use 



• Ship all tests and materials to SRI. except Schaefer 
-use Air Freight- 
Also: Seig^S^I^in^^l^^^^^ gig^d 



Schaefer Behavior Inventory 
Completed this week 



• Return a] 



laef er forms 



-use ^iiof SVSilB^maf S^^ 
AND include completed Stlpend/Honoral^'iumRecords 
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MEMO 



TO: 



Site Coordinators 



August 24, .1971 



FROM; 



Cindy Sousia 



LOCATION: 



SUBJECT: Shipping materials 



Ref: HS 296 



On 



1971 



test kits were mailed to you. 



The kit lumbers are 



If you have not received these kits 1^ 



please 



contact me or Mike Duffy at (415) 326-6200 ext. 2407. 

On 1971 all the materials for the Polaroid 



cameras were sent to you. This should include 1 camera, 1 wink 
flash unit, 1 carrying case, 1 pack of black and white film and 
sufficient color film and flash bulbs to take all the pictures 
for the Brown Self Concept Referents Test. 

You will find all the packing lists enclosed to enable you to 
check the contents of your test kit. 
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STANFORD RESEARCH INSTITUTE 
MENLO PARK. CALIFORNIA 94025 
(415) 326-6200 



To: Head Start Planned Variation Sponsors 
Enabler Model Consultants 
Head Start Assistant Regional Directors 
OCD Planned Variation Consultants 

OCD Planned Variation Review Panel HS-306A 
Subject: Fall 1971 Evaluation Plans Date: August 27, 1971 



Starting in June 1971 the role of SRI is limited to the implementation 
of data collection activities necessary for the PV Evaluation. The 
analyses and reports (for 1970-71 and 1971-72) are the responsibility 
of Huron Institute, Cambridgei Massachusetts, under a grant from OCD. 
The test battery, data collection procedures, locations of testing and 
numbers of classes to test are specified by OCD (and Huron). 

Fall Testing 

The pupil test battery is shown in Figure 1. 

The Testing/Data collection periods are shown in Figure 2. 

The locations of the testing sites are shown in Figure 3. Level I 
sites complete only: 

1. Classroom Information Form 
5. Teacher Ratings of Children 
7. Teacher Information Form 

The Level III Sites complete all activities. Des Moines and Providence do 
not have PV, but do participate in Follow Through; they are included to 
enhance the longitudinal evaluation of Head Start/Follow Through. 
Huntsville and San Francisco are two areas where control children will 
be tested, i.e. Head Start eligible, but not participating in Head Start* 

The number of classes to be tested in each site is shown in Figure 3. 
(The = sign is. read "equivalent to this many classes of 17 children.") 

The date of testing is shown in Figure 4. 

The names of the Site Coordinators is shown in Figure 5. 

The estimated number of testers , per site is shown in Figure 6. 
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August 27, 1971 



Recent Events 

On July 28-29 a meeting with all Level III Head Start Directors 
was held at SRI. It covered all the details of the 1971-72 data collection 
activities. Enclosed is a copy of the follow up memo (August 13, 1971) 
sent to these attendees. 

On August 2-6 a coordination and training session was held at SRI 
for all the Site Coordinators from the Level III sites. Enclosed are 
follow up memos sent to the Site Coordinators (August 18, 1971 and 
August 23, 1971). 

Coordination with Level I Head Start Directors was initiated by 
telephone and followed up by the memo of August 20, 1971 (enclosed). 

Please note that in the various tables and memos there are changes 
in the numbers at various sites. Please refer to the dates of these 
tables to be sure you are using the latest figures. 



Cordially, 




Tor Meeland, Ph.D. 

Senior Research Psychologist 

Project Leader 

Head Start Planned Variation Evaluation 



TM:kb 
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Figure .'L 

PUPIL TEST IIATTERY 
HEAD START PLANNED VARIATION EVALUATION, 1971-72 



FALL 1971 

Basic Battery 

Peabody Picture Vocabulary Test (PPVT) 

Wide Range Achievement Test (WRAT) 
- Letters & Numbers - 

Pre-school Inventory (PSI) 

- with Hertzig-Birch Scoring - 

Brown Self Concept 

Supplemental Battery (1/3 of each class) 
Enumeration 

Illinois Test of Psycholinguistic 
Ability (ITPA) 

Motor Inhibition Test ~ Haccoby 
Truck Pull Only 

8-Block Sort ^ Mother-Child Interaction 

(Parent Information Form given to 
these mothers) - 1/3 of each class 



SPRING 1972 

Basic Battery 
PPVT 

WRAT - Total test 

Brown Self Concept 
PSI with HB scoring 

Enumeration 

Supplemental Battery (1/3 of each class)' 

ITPA 
Sigel 

Motor Inhibition 
Gumpgookies 

8-Block Sort - 1/3 of each class 

To be split into: 
Basic Battery A and 
Basic Battery B. 
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TESTING/DATA COLLECTION PERIODS 
FOR HEAD START PLANNED VARIATION EVALUATION, 1971-72 

1971-72 

Sept Oct Nov Dec Jan Feb Mar Apr May June 



1. Class Information Form 

2. Pupil Testing 

Basic Battery A 
Basic Battery B 
Supplemental Battery 

3. 8-Block Sort 

4. Parent Information Form 



5. Teacher ratings of 
children ^ 



6. Class Observation 

7. Teacher Information Form 

8; Head Start Director* s 
Ratings of Teachers 

9. Sponsor* s Ratings of 
Teachers 

10. Sponsor Implementation 
Report 



X X 

X X 

X X 

X X 

X X 

(short form) 



X X 

(in 7th week) 



X X 



X X 



(long form) 



X X 



X 
X 
X 



start in second week of class; completed in three weeks 
/Schaefer Behavior Inventory 
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Figure 4 
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DATE 



Figure 5 
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6. Parent Quest ionna ire 

During the period the mother is at the center for the 8-Block Sort 
task, she will be asked to complete a questionnaire to be administered 
by the 8-Block trainer (see below). A Spanish version will be supplied 
for those mothers who feel more comfortable reading Spanish. The 8-Block 
trainer is only an administrator of the questionnaire but In the event 
the mother is unable to read, the 8-Block trainer must present the question- 
naire orally. The trainer should show tact at this point so a mother who 
is illiterate does not feel dehumanized. Please suggest to the trainer 
a style and procedure to overcome the awkwardness that can result if a mother 
cannot read. For instance, the trainer can start reading each questionnaire 
for each mother and give up this task if the mother volunteers to read by 
herself. Remember that we sincerely wish the mother* s responses to be 
confidential to SRI (except if the trainer reads the questionnaire) and we 
have provided envelopes for the mother to insert her completed form so that 
the trainer is not party to the responses. However, it is important that 
the trainer, by asking the mother, be assured that every item has been 
answered. 

In the event the mother does not understand a question, it is preferable 
for the- trainer not to explain the item and for the mother to write "don*t 
understand." It is permissible for the trainer to explain the meaning of 
word s , howe ve r • 

7. Binet Testing 

The Binets with Hertzig-Birch scoring are scheduled for^^administration 
this spring to the children who received them last fall. The refreshing of 
old testers and preparation of new ones is being coordinated by Phil Baker, 
extension 3269. 

A check list of procedures and testing steps is included with the test 
forms in the Site Coordinators test kit. 

For the amount of money we pay the Binet testers, it is reasonable to 
expect them to complete the forms as specified. Also, 30-45 minutes is 
a reasonable time for testing one child; longer if rapport problems are 
present; certainly not 10-20 minutes. Please watch the Binet testers 
carefully in the beginning to be sure that the testing conditions are good. 

8. Testing Space 

Space for testing will be a critical item in Level III sites since one 
or more Auxiliary Battery testers, Binet testers and the 8-Block Task 
require separate rooms or spaces. Where test space is short, you should 
consider doing the testing in different classes simultaneously, i.e., 
ABT in one (or 2 classes) Binets in a second and 8-Block in a third. 
Scheduling then becomes a bit tricky, but with care, it could work. 
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SRI 



MEMO 



^® Site Coordinators/Testers ^^"^^ Sept. 1, 1971 

FROM: Phil Baker location: 
suBJECTiGENERAL INSTRUCTIONS for Fall Head Start Testing cc: 



Memos from Tor about several administrative details have already been sent to 
you. This memo serves to tie up some loose sends regarding testing procedures. 



1. Who to test . All children who have been enrolled at least 5 days In the classes 
tested are to be tested* Children who have not been enrolled 5 days In the 
classes tested are not to be tested. 

2. The Record of Children Tested (RCT) must contain the names of all children who 
were and should have been tested. If a child was scheduled for testing, but 
wasn*t tested t his name must appear in the RCT along with a note explaining 
why he wasn't tested (i.e., Illness, moved away). 

3. If a child in the Supplementary Battery sample is not tested for some reason, 
note why he wasn't tested, and then select another child for Supplementary 
Battery Testing. Usje .the Sheet of Random Permutations for this selection. 

Remember that these children also get the S-Block Sort Task. Be sure to co- 
ordinate any changes with the 8-Block Trainer so that we wind up with the same 
children for the Supplementary Battery and the 8-Block Sort when at all possible. 

4. When you or your testers practice giving tests, do not use any of the children 
you will be testing or we'll take away your tow truck. Actually, this is a 
serious matter. Don't do it! 



5, When giving tests, the table where the Tester and child sit*must be kept clear 
of materials except when they are being used. A chair or small stand beside 
the Testidr can be used to hold necessary materials. It is very important that 
these things be kept out of sight when they are not being used. 

6* Testers are to use the pencils furnished in the kits. The children use the big 
pencils that Bill Cosby says they can lay on their shoulder when they are using 
them. 

7« There are 3 special codes to be used in scoring: 

NR - when the child makes no response whatsoever. 
R -* when you repeat a question. 
Q -* when you use a probe. 

These codes go on the score sheets along with the answers. 

8. There has been aojne question about the difference between irrelevant and vague, 
responses. An irrelevant response is one which you understand, but has nothing 
to do with the required task. A vague response is one whose meaning or intent 
is unclear. When probiiig is permissible, a vague response is probed for the 
exact meaning. An irrelevant response is not probed. 
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9. 
10. 

11. 
12. 

13. 

14. 

15. 
16. 

17. 



On stopping a test . If a child has refused to respond to 4 items in a row, 
discontinue the test. There are other situations where the test may be dis- 
continued; these are a matter of Judgment. If a test is discontinued, the 
condition resulting in the discontinuation must be recorded on the log sheet 
(on the envelope for that child). 

Peabody Picture Vocabulary Test (PPVT) . Check the picture book for double- 
image or bleed -through. Do not use books that contain bad plates. Call Mike 
Duffy collect at (415) 326-6200* ext. 2407. 

The number of the picture the child points to is written in the response blank 
on the PPVT score sheet. Be sure to cross out the figures beside items that 
are missed. Stop testing when 6 out of 8 consecutive items are missed. 

WRAT. Do not give the ORAL arithmetic on page HS-8. 

PSI. Use the Hertzig-Birch scoring on this test. Code only the last response 
the child makes to each item. Put all Qs, Rs, and NRs in the "Comments" column. 

Enumeration . On the middle section, no instructions are given to the child 
after item 6-B. He just turns the pages and points. If you have to prompt the 
childt be sure to enter it in the "Comments'* section. 

ITPA . Put the test objects In a bag or box so the child cannot see them. The 
objects are presented to the child one-at-a-time. 

MI^. See enclosed instructions on i|se of stopwatch. 

Brown Self-C!oncept . Always look at the picture and point to the child in the 
picture when giving each item. 

Call me (x. 3269) if you have questions. 
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MEMO 



TO: 

PROM: 

SUBJECT: 



Head Start Traveling Staff 

Some Questions Which May Be Raised 

In Your Meetings with Community Persons 



DATE: 9/2/71 

LOCATION: 

CC: 

Ref : HS-310 



Here is a quick restatement of the major facts concerning questions 
which may be raised in the communities you visit in the course of super- 
vising the fall testing* I have tried to cover the points discussed 
In the earlier project meeting. 

1. Feedback of data to the community - Reports on the child testing 
will become available through OCD. For example , the results of the 1969- 
70 examination of the test data which was presented to OCD by SRI has 
been reproduced by OCD and distributed to quite a large mailing list. 
Including the ARDs. A nontechnical version of the first year report has 
been published by OCD and distributed widely. The Head Start Director 
has probably received a copy by now. 

2. Data requests for particular children - Any requests for test 
scores on particular children must be made to OCD. 

3. Why are these particular tests given - The present test battery 
has emerged' from several years of work in Follow Through and Head Start 
evaluations. In particular , the last^'six months have witnessed a set of 
Intensive meetings at OCD and at SRI with Follow Through, the Head Start 
sponsors* representatives, OCD consultants, Educational Testing Service, 
and other experts in early childhood education in attendance. Since the 

various models have slightly different objectives and routes by which t 
they achieve these objectives, no small set of tests can adequately assess ] 
the impact of this wide array of programs. However, contained within 

the present test battery there are measures that are responsive to the ] 
various models, and although all tests do not respond to the main j 
thrusts of each sponsor, they do represent important areas of child | 
development which are essential to assess in order to see the supple- 
mentary or subsidiary affects that accrue from the application of the 
various PV programs. 

Note: The rationale for the tests is stated briefly In Janets 
summary which Is in your packet. 

4. Don't the tests take too much time - The Basic Battery requires 
30 minutes, the Brown 10 minutes, and the Supplementary tests 20 minutes, 
plus 30 minutes for the 8-Block Sort resulting In a maximum testing time 
for a child of 1} hours. This is not a particularly long Investment of 
time for any particular child. However, we are ajvare that other tests 
are often given in the community, e.g., by the sponsors, the city pro- 
grams, state requirements, and various graduate students who make use 
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of the children for the data collection purposes. Our experience to date 
has been that the children do not object to the tests, indeed they find 
them fun, but it is the adults and administrators like ourselves who 
feel that the test time seems excessive. 

5. Test difficulty - In order to assess the development of children, 
it is necessary that tests be applicable for a period of at least a year. 
This means that the tests cannot be too easy in Head Start or else they 
would be inadequate at kindergarten or entering first grade. On the 
other hand, tests appropriate for the second and third grade children 

who are participating in Follow Through would be much too difficult for 
application to Head Start. As a result, the tests that are included in 
the present battery do contain items that are difficult for the children 
entering Head Start; they will typically do better at the end of the year 
and probably top out by the time they finish kindergarten. During the 
Follow Through evaluation these tests which have "a low ceiling" are 
replaced by tests of greater difficulty. 

6. Are the test scores confidential - No individual test scores are 
available to the public. All summaries based on the analyses of the data 
use the classroom as the smallest unit. Our testers have agreed to treat 
these data as confidential and when they are returned to SRI they are 
immediately assigned code numbers to preserve the anonymity of the 
individuals. 

Why was this site chosen for PV - In 1968 (with a few exceptions 
starting in 1967) Follow Through, not Head Start, offered a series of 
sponsored programs to communities around the country. Descriptions of 
the programs were made to the sponsoring agencies in these communities 
and the community was to select which program it wished to follow. There 
were some instances where because of local inertia or lack of organization 
the decision for following a particular program could have been made by 
one person (for instance, a superintendent of instruction) but these 
circumstances are the exception. 

In 1969 OCD was able to provide the support to push these programs 
down to the preschool year (Head Start). In that year, eight of the 
larger and more established programs (in terms of logistical capability, 
primarily) were selected for the preliminary year of the PV evaluation. 
For each of eight sponsors two communities were selected where the pro- 
gram seemed to have been successfully implemented in Follow Through. 
In these communities, the choice was offered to either incorporate the 
program or not to incorporate the program into Head Start. In 1970 
the number of communities was enlarged to 36. Again the only choice 
was whether or not a community was willing to implement Planned Variation 
in Head Start using the program already in effect in Follow Through. 
You see, it would make little sense to have one sponsored program in 
Head Start followed up by a different sponsor In Follow Through. Since 
the specific ccxmnunity in which Follow Through was first inaugurated is 
contiguous with the Head Start community, it seems reasonable to believe 
that the initial choice of sponsor represents the general preference 
of the community in question. 
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8. Why did the test level change In our community - This third 
year of the PV evaluation was always scheduled as a major effort and 
consequently there was an Increase In the number of Level III test sites 
in order to gather as much data on each of the programs as was possible 
within the constraints of the budget available to OCD. This was also 
true last year and thus the shift in test level for a community is no 
reflection on the caliber or work being done in any location. The 
decisions that OCD faced were very difficult ones in order to achieve 
the optimum configuration of children of various characteristics within 
the budgetary restrictions. 

9. What is the story oft comparison classes - The intent in 1969 
was to find classes in ^^'oh community that had the same characteristics 
as the Planned Variation classes but were not in PV. These classes were 
to provide reference points for determining the effect of FY. In some 
conununities it was impossible tp find comparison classes because every 
child in Head Start was participating in Planned Variation and conse- 
quently it was necessary during the first (and also the second year) to 
employ **off-site" communities as comparison groups. Although these 
communities were many miles distant, they were to agree with the basic 
community in terms of age of the children, racial ccmiposition, and 
degree of previous Head Start experience. Upon close examination of 
the data from the first year, it became clear that the off-site compari- 
son groups were not in fact good references for the evaluation; in 
addition, the FT testing was not done in these locations. A shift in 
the evaluation design was indicated for 1971-72. 

Comparison classrooms are being tested which can be reassembled in 
any convenient way for the issue under consideration: according to 
ethnic make-up , socio-economic status, prior Head Start, and geographic 
location or urban-social characteristics. As a result of this shift 
in the analysis plans, which was a natural outcome of the previous 
experience, only 12 locations incorporate **cc»iparison" classrooms. In 
order to increase the number of children of particular characteristics, 
two communities have been included (Providence and Des Moines) which 
do not have Planned Variation, but where the children in the comparison 
classes tested are expected to progress into schools where SRIs Follow 
Through project will be doing their testing in subsequent years. Such 
a plan increases the likelihood of achieving a longitudinal view of 
these children. If you have seen our tally sheets of the Planned Variation 
sponsors, you will have noticed. that for a couple of them there are no 
comparison groups available for these particular sponsors. '^Synthetic" 
groups can be assembled from the 56 comparison classes being tested 
elsewhere. 

A second comparison or control group has been incorporated for this 
year*s evaluation. It consists of children who were eligible for Head 
Start by virtue of their qualifying under OEO standards of poverty, but 
who for one or many reasons were unable to be included in Head Start 
classes. We are doing this control study in the San FrAicisco area and 
also in the Huntsville, Alabama, area. This control group will add 
considerable power to th^3 analytic treatment of the data being gathered 
in the Planned Variat ion communities. 
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10. What are the other PV programs - We prefer not to be the "agent" 
for disseminating this information in the communities* Descriptions of 
the 8 programs in the first year PV evaluation are contained in the non- 
technical and technical reports. A fuller description of these programs 
and otheiB included in Head Start PV and Follow Through has been published 
in book form by Eleanor Maccoby, professor of Early Childhood Education at 
Stanford University. The title of this book is Experiments in Primary 
Education - Aspects of Project Follow Through , published in 1970 by 
Harcourt Brace Jovanovich, Inc. 

11. Why are only some classes given the pupil tests - A preference, 
of course, would be to test e>»ery child in Planned Variation, but budget- 
ary restrictions are at work. An upper limit of six Planned Variation 
classes per community was established as a desirable minimum (consistent 
with budget resources) for the analytic design envisioned for 1971-72. 

In communities where there are more than six PV classes, certain priority 
rules were applied. For instance, it was desirable to use those teachers 
who had been tested last year and those who had the most experience in 
the Planned Variation program of the community. Also we had to bow to 
the need to include those classes that would most likely wind up in 
schools being tested in the SRI Follow Through evaluation in order to 
enhance the opportunity to examine the longitudinal effects of the pro- 
grams . 

12. Why are some Children not tested in the tested classes - We 
attempt to test every child who has had at least one week of experience 
in the class. For those children who arrive too late to so qualify, we 
have instructed the Site Coordinators that at least one test be .given 
to each of these "extra" children so that they will not feel left out of 
the classroom activity. We have suggested that the Brown be the test 
so administered. 

13. Will PV programs be compared - Here the answer is both yes and no. 
No, to the extent that there is no intention to try to identify one 
program as being "better" than another. However, it is necessary to 
understand the specific kinds of gains that occur over particular periods 
of time for particular groups of children in particular locations with 
particular expertise of teachers. The limited comparison of this type 
that were done for the first year report have all been so coded that 
neither the sponsors nor the communities can be Identified. The names of 
the various PV programs are less important than the processes they employ. 

14. Will teachers be compared - Individual teachers will not be 
compared. Group data based on teachers of common background and perhaps 
age and education will be examined to determine If there are any differ- 
ential affects in the way the children under their tutelage progress. 

15. Will communities be compared - Communities per se will not be 
compared. The present analysis calls for the examination of sub groups 
of children depending upon the geographical location, ethnic composition, 
age, and rural/urban characteristics. 
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16. Will the teacher stipends come late again - We have had some 
delays In the payment of teachers* stipends, but It Is not always our 
fault. Before payments can be made It Is absolutely necessary that 
honorarium vouchers be submitted to our business office with correct 
mailing addresses and social security numbers attached. We think we 
can avoid unnecessary delays If the Site Coordinator forwards the com- 
pleted forms to us promptly. 

17. Differences In the stipends paid to the Head Start and Follow 
Through teachers . - Follow Through pays Its teachers an honorarium of 
$10 once during the year for the completion of a teacher Information 
form and assistance with the classroom roster (what we call the Class 
Information Form). Head Start, on the other hand, requires a teacher 
to complete the Classroom Information Form and the Schaeffer Behavior 
Inventory on each child In her class In the fall and spring. For this 
effort she Is paid $20 fall and $20 spring. In addition, we provide 
her a stipend of $10 for the completion of the Teacher Information Form. 
It seems to us that this Is an equitable remuneration for the various 
activities of the teachers In Head Start and In Follow Through. 

18. What Is Huron and Its relationship to SRI - Last spring OCD 
rightfully acknowledged the tremendous demands that were made on our 
staff to field this huge evaluation, do the analysis, and prepare the 
detailed reports required. Considering also the demands of Follow 
Through which Is many times as large as the PV evaluation. It was 
unreasonable to expect that our present staff, as large as It Is, could 
be completely responsive In a timely manner to all of the needs of this 
most critical experiment with the preschool children. OCD was very 
fortunate In obtaining the participation of the Huron Institute In 
Cambridge, Massachusetts, to handle all of the data analyses and 
reporting. It Is the hope of OCD and also of the Institute that this 
division of labor will result In & more timely and Incisive examination 
of the data that Is generated from the Planned Variation evaluation. 

To this end, Huron wishes to visit many communities In order to gain 
a first hand understanding of the operations of Planned Variation In 
the communities. We hope you will welcome them as friends and an Inte- 
gral part of a broad spectrum team which Is concerned with the assess- 
ment of the Impact of Planned Variation on the young children. 

19. Will SRI return here and who will come - Within the limits of 
the budget available to us, we hope to have the same people come back 
later In the year to help with the coordination and Implraentatloh of 
the evaluation activities. Certainly It Is to our advantage for the 
same people to come back to old friends and acquaintances. 
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MEMO 



TO: 



Site Coordinators 



DATE: 9/2/71 



FROM: 



Tor Meeland 




LOCATION: 



SUBJECT: 



PIF Records on "Record 
of Children Tested" 



CC: 



In the extreme right-hand column, add the 
heading: 

MOTHER RECEIVED HELP WITH PIF 

The 8-Block trainer should enter "Yes" or 
"No" for each child. Mark "Yes" for help If 

a) PIF was read to the mother or 

b) several of mother *s questions had to 
be answered regarding completion of 
the form. 
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TO: 

FROM: 

SUBJECT: 



Lois-ell in Datta 
Mike Smith 



Tor Meeland ' j-^ 
Fall Site Visits 



DATE: 9/2/71 



LOCATION: 



CC: 

Ref : HS-313 



It is expected that many questions will be raised in the communities 
about the Planned Variation evaluation during the period the project 
staff is on site for the initial testing in fall 1971. 

Attached is a set of guidelines for our traveling staff for guidance 
in their responses to questions that may be raised in the communities by 
the Head Start Director, teachers, or other people concerning many of 
the issues that pertain to the Planned Variation evaluation. If in your 
reading of these guidelines you find some misstatements of fact, would 
you please call me immediately so I can transmit the changes to our 
people in the field. 

Our intention is for some member of the project staff to be present 
at least one day prior to the beginning of testing in each and every 
community. So far the visiting schedule seems to be a viable one, but 
each change in the starting dates of Head Start centers results in a 
perturbation that causes considerable s^ief and realignment of itineraries ^ 
In the event that a project member cannot appear on site prior to testing, 
we are requesting the Site Coordinator to delay testing one day in 
order to permit a final checkout qf the testers* procedures, the testing 
room conditions, and scheduling details. 

In past months we have talked about OCD or Huron people being 
present when SRI personnel are on site. Our preference is for these 
visits to come after the testing starts to permit our people in the 
field to resolve the various expected difficulties of test implementation 
without the distraction of visitors. However ^ we think it is parti- 
cularly important for both Huron and OCD to see the implementation of 
the testing. 

Enclosed Is a copy of our travel itineraries as of the date indi-* 
cated and subject to chan{i:e according to delays in class starting dates 
that may occur in any community. Would you please coordinate with me 
with respect to those communities that you plan to vifiit? 
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MEMO 



TO: 



Site Coordinators 



DATE: 9/29/71 



FnOM: 



Tor Meeland 



LOCATION: 



SUBJECT 



Schaefer Behavior Inventory 



CC: 



Ref; HS-329 



As was discussed during the fall meeting, the Schaefer Behavior 
Inventory forms were to be sent to you during the fifth week of class. 
The enclosed Schaefer forms are to be distributed to your teachers so 
that they will have time to study the directions before they complete 
the forms during the seventh week of class. 

Please direct the teachers to consider carefully the section in 
the Teacher Manual "Developing a Frame of Reference for Ratings." It 
is important that they think about the behaviors and observe their 
children before making any ratings. Ask .them to complete one Inventory 
form for each child during the seventh week. 

Enclosed are STIFEND/HONCXIARIUM FOR TEACHERS foxms on which you 
should enter the teachers* names, addresses and social security numbers. 
These forms differ from the ones you have only to the extent of changes 
in the first sentence. If you have already completed the old foxms, 
simply attach them to the new ones-- and save yourself the rewriting 
time. 

Please collect the completed Schaefer forms at the end of the seventh 
week and return them, along with the STIPEND/HON(»ARIUM forms, to me in 
the enclosed envelope, REGISTERED. Remember to enter the mailing cost 
on your invoice so you can be reimbursed. 

Your teachers should complete the forms during the week of 
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Appendix F 

SPRING 1972 COMMUNICATIONS 
CCOTENTS 



Date 

* 1 Feb 72 

2 Feb 72 

* 4 Feb 72 
♦29 Feb 72 

* 1 Mar 72 

»i 

* 2 Mar 72 

7 Mar 72 

10 Mar 72 
15 Mar 72 
17 Mar 72 

17 Mar 72 

* 28 Mar 72 
27 Mar 72 

♦28 Mar 72 
*29 Mar 72 



To 



HSDs 



HSDs, 
Level I 

SCs 



SCs 



HSDs 



Subject 
Last Day of Class 

Last Day of Class 



Availability as Site 
Coordinators for Spring 

Spring 1972 Training and 
Testing Plans for HSPV 

Spring 1972 Testing Plans 



OCD - PV Quality Control Procedures for 

Review Panel the HSPV Spring Testing, 1972 

Testing Payment Schedule 
SpringAl972 



Address List for HSDd and SCs 

Estimated Field Staff Requirement 

Site Coordinator Attendence List 
for March 20-24, 1972 

Site Coordinator Attendence List 
for April 10-14, 1972 

27 Item Version of Gumpgookies 
to be Used in HSPV Spring 1972 

Some Financial Guidelines for 
Spiking Testing 

Spring 1972 "Tests to be 
Administered" ^ 

Letter of Understanding 



Record 



Project 
Staff 

SCs 



SCs 
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CCKTENTS (Continued) 



Date To Subject 

*30 Mar 72 OCD Monitors Procedures , Manuals , Score 

Forms y and Quizzes Used for 
Spring Testing 

Mar 72 Guidelines and ln&t"»*uctlons 

for Completing Invoices 

Mar 72 Head Start Planned Variation 

Mailing List, Spring 197^ 

Mar 72 Tests to be Administered 

(computer printout) 

4 Apr 72 HSPV, Spring 1972 Testing 

and Field Supervisors' 
Schedule 

* 5 Apr 72 OCD Monitors OCD Monitoring of HSPV Sites 
OCD Monitors HSPV Spring 1972 Site Visits 

6 Apr 72 Number of Classes and Meeting 

Times 

7 Apr 72 Rationale for Tests Used 

1971-72 

"^12 Apr 72 HSDs Director's Evaluation of Model 

and Implementation Report 

Apr 72 Shipping Schedule 

Apr 72 Shlppl Shipping Alert Letter 

Apr 72 Schedule for Site Coordinators 

Apr 72 HSPV Calendar of Spring 

Activities 



CONTENTS (Concluded) 



Date To Subject 

Apr 72 Locations for Administration 

of Aide Questionnaires and 
Aide Schaefers 

Apr 72 Guidelines for Test Administration 

Apr 72 Procedures for Tester Training 

Apr 72 Tester Training Week Schedule 

Apr 72 8-Block Scheduling Letter 

Apr 72 Responsibilities Related to 

8-*Block 

Apr 72 8-Block: SC and SRI Field 

Supervisor Check List 

Jun 72 USDs Appreciation 



HSD = Head Start Director 

SC = Site Coordinator 

8BST = 8-*Block Sort Testers 

CO = Classroom Observer 



MEMO 



OATC: 2/1/72 

LOCATION: 

CC: 

Ref: HS-429 



In order to schedule the spring testing for the PV Evaluation , we 
must have confirmation of the last day of class. 

Our records from the summer meeting of Head Start Directors show 
that your last day of class Is: 

, 1972 



Is this correct? Yes ( • ) No ( ) 

If "no" 9 what Is your planned last day of class? 

, 1972 



Test schedule : The general plan Is to complete all testing by 
June 2p 1972, For those communities that end their programs before June 9, 
1972, we would like to conduct the spring testing during the 4th - 2nd 
week before classes end. This will leave the last week of class free 
from any SRI testing. 

In the past we have found that public school closing dates affect 
the attendence In Head Start classes. ThereforSi It would assist us in 
planning test schedules to learn from you the last date of public school: 

, 1972 



I would appreciate an Immediate reply from you by filling in the 
requested information on the original of this letter (keep the copy for 
your records) and returning it to me in the enclosed » self -addressed 
and stamped envelope. 




SUBJECT: Lsst Day of Class 



P-7 



•SI ssds us 




STANFOHD RESEARCH INSTITUTE 



To: 



Site Coordinators 



Dale: 2/4/72 



F'rom: 



Klara Evans 



Location: 



Subject; 



Availability as Site Coordinators this Spring 



Answering: 



In preparation for the Head Start Planned Variation Evaluation this 
Spring, I need to know whether or not you will be available to act as our 
Site Coordinator in your community a^ain. The final s^chedule for training 
and testing, etc., is still contingent upon a number of unknown factors. 
The training and testing will occur between March 27 and June 2, 1972. 
Your activities will require u£ to five (5) weeks sometime during that 
time period . 

Our experience has shown that the Site Coordinator responsibilities 
require full time participation during the above mentioned period. If 
your circumstances are such that full time participation is impossible 
please contact me by calling collect: (415) 326-6200, Ext. 2517. 

If your situation is simply a matter of whether or not you can con- 
tinue as our Site Coordinator, I would appreciate a note from you by 
Friday, 2/11/72. If you will not be available, it would be a great assist 
to me if you would also give me a name(s) of anyone that you feel would 
be a good successor to you. Along with any names, please include some 
background information as well as addresses and phone numbers. 

Hopefully, we will be able to inform you of more definite plans by 
the end of this month or early next month. Delays in planning have occurred 
due to a variety of details such as final decisions regarding the test 
battery, determining our manpower requirements, and school closing dates 
which haw been requested of the Head Start Directors, etc. As soon as 
these issues are resolved, we will be able to inform you of a definite 
schedule for the Spring training and testing. 



Klara Evans 

Supervisor of Field Operations 
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MEMO 



TO: DATE: 2/29/72 

FHOM: Klara Evans location: 



8UBJECT: Spring 1972 Training and Testing cci 
Plans for Head Start Planned Variation 



Ref: HS-444 



Plans for the Spring testing have finally fallen into place. Tliere 
will be two separate Site Coordinator training sessions (March 20-24 and 
April 10-14) in Menlo Park, California to allow for smaller groups and 
more Individualized attention. 

There is an addition of two tests: Gxunpgookies in the Basic Battery 
and Relevant Redundant Cues (Zings and Poggles) in the Supplementary 
Battery. This will, in mo^tt cases, entail some additional testers for 
you— -actual staff requireinents will be elaborated upon when you attend 
the training session. 

The Brown is going to be continued only in the Classroom Observation 
sites 9 and the 8-Dlock Sort Task has been dropped in all sites except in 
Jonesboro, Arkansas; Houston, Texas; and those sites that have had Class- 
room Observations. The training session for 8-Block Sort Observers is al- 
so to be held in Menlo Park on April 17 - 20,21. The decision regarding who 
is to be the 8-*Block Observer for this spring will be made by SRI. Since 
many of the sites are using last fall*s 8-Block Observer as a Classroom 
Observer this spring we will continue with the same person. However, there 
may be some necessary changes. Therefore, we will be in contact with either 
your 8-* Block Observer or Classroom Observer in the immediate future. 

The Office of Child Development in Washington, D. C, has asked 
that our Field Supervisors give longer and more detailed coverage for 
each site during on-site training and testing. Therefore, the scheduling 
of testing is affected not only by the closing date of your community's 
Head Start program but also by our staff travel needs. In the past, we 
have found that public school closing dates effect the attendance in 
Head Start. Hence, in those sites where public school closing dates 
precede Head Start closing dates, we were compelled to take public 
school dates into consideration when scheduling our testing as well. 
The Head Start Directors have provided us with closing date information 
via a nemo to them on February 1, 1972. 



Your scheduled training session in Menlo Park is for _ 

through , 1972. Testing is to occur in 

on 



through 



1972. 



Closing dates for classes in your conmunity are 

, , 1972 for Head Start and , 

for public schools. If you find that there are any serious conflicts 
in your schedule, please contact Becky Simons or myselif immediately. 
Otherwise, youUl be contacted shortly regarding your final travel 
arrangements, etc. in the same way as last fall. 



1972 



Sincerely, 
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Klara F. Evans 

Supervisor of Fl0ld.|^|Mations 



MEMO 



TO: 



OCD Planned Variation Review Panel 



DATE: 



3/2/72 



„OM: Tor Meeland / 

SUBJECT: Quality Control Procedures for the Head Start 
Planned Variation Spring Testing, 1972 




LOCATION: 



CC: 



Ref ; HS-447 



The plans for the spring testing data quality tontrols that were 
discussed and agreed to at the meeting on November 15, 1971, are to 
be Implemented In the following way: 

1 . Planning Information sent to the Head Start Directors . Attached 
is a copy of the spring plans and procedures that have been sent to the 
Head Start Directors in the test sites. 

2. SRI Project Team preparation . A full scale dress rehearsal of 
testing procedures will occur March 13-17, during which period all 
project members who will act as field monitors will have a final review 
of test procedures using preschool children as subjects. This activity 
Is essential to make a final assessment of the pro^^edures to be used for 
the Site Coordinator training sessions and the final practice of the 
monitors to administer each test and procedure. 

3. Use of tefet and procedure tests . A series of written tests have 
been developed to assess the level of Information that testers possess of 
the procedures to be used In administering each test. In addition, a 
test has been prepared covering general testing practices. These tests 
will be used In two ways: 

a) to provide a learning activity during, the training session^ and 

b) as a minimum criterion for acceptance of the tester* s profl- 



These tests also provide the SRI field monitoring staff with an objective 
means to assess the level of competency of local testers If a question 
arises as to the knowledge of the testers with respect to the testing 
procedures that must be followed. 

Last fitll we experienced Incidents where monitors were not completel; 
familiar with the exact testing details. It is felt that any non-SRI 
monitor who Is to assess the testing procedures should also pass these 
tests before being permitted to act as a critic of the field testing. 
I know of no previous occasion in a national evaluation that such a 
requirement had to be met; It would auger well for a superior level of 
monitoring. 

4. Site Coordinator Training sessions at SRI will be condU';ted at 
two times (March 20-*24 and April 10-*14) to provide more intimate and 
detailed Instruction than would be possible with a single large ireetlng. 
During this training each Site Coordinator will be required to practice 
the testing with pre-*school children, working In pairs so that each 
member of a pair has the opportunity to observe his teammate in action 
and can thus profit from the observation and also contribute to the 
criticism of his partner. 



clency level. 
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New Site Coordinators (Ft, Walton Beach , Des Moines and Newburgh) 
will be given an additional (5th) day of training in operational proce- 
dures to compensate for their lack of fall experience, 

8-Block Testers will be re-trained at SRI March 17-21 for those 
sites that had Class Observations, plus Jonesboro and Houston, 

SRI Monitoring will occur in each site for at least five days (2-3 
days during the training week and 2-3 days during the testing,) 

For sites where we have replacement Site Coordinators (Ft, Walton 
Beach, Des Moines and Newburgh) and Houston (where we feel additional 
coverage is indicated) SRI staff will be present during the week of 
tester training and for an extended period (five days or more if needed) 
during the testing. To accommodate to the monitors* itineraries, a 
second monitor may cycle back to these sites during the testing, if 
needed , 

Test Schedule 

As concurred in during the November 15 meeting, the test periods 
in each site will be adjusted to accommodate to the travel requirements 
of the project staff. The test dates shown in Table 1 consider the 
Head Start closing dates, public school closing dates (because prior 
closing of public schools sometimes ro'iuces Head Start attendance) and 
the travel itineraries of the project staff. Changes may occur in 
these dates according to later information received from the Head Start 
Directors, 

Field Monitoring Staff from SRI will be composed of J, Lotridge, 
G, Gillis, K, Preecs, B, Simons, P, Baker, C, McCarty, J, Stallings, 
R, Mason, and D, Booth, with K, Evans, W, Hamberg, and T, Meeland as 
ready standbys, Meeland will be used if serious issue? of policy or if 
major troubles arise. Each staff field monitor will be travelling about 
si weeks. 

Data Quality Procedure's will incorporate the records kept by each 
tester (Tester Log) and the Site Coordinator (Site Coordinator Log), 
These logs are formal booklets that provide for the detailed description 
of testing anomolies that taay occur, testing room descriptions, and 
assessments (by the Site Coordinator) of the tester*s performance. The 
SRI monitors provide the necessary support and guidance needed to imple- 
ment the prescribed testing procedures. If a circumstance occurs that 
is not covered in the prescribed procedures, the monitor must contact 
SRI for resolution of the problem. This procedure is necessary to pro- 
vide a means for consistent and rapid dissemination of any indicated 
chang:e8 to all sites simultaneously if the need arises, 

(Coordination of OCD and Huron Monitors , To g|tln maximum benefit 
of non-SRI monitors it is imperative that any observed testing procedure 
discrepancy be communicated immediately to T, Meeland at SRI in order 
that an effective and coordinated change can be made, A three or four 
week old report is useless in terms of correcting a mistake. It is 



Imperative that a direct channel of responsibility be used if a correction 
is to be made. The testers are answerable to their Site Coordinators 
)irtio in turn are responsible to SRI alone. There is no effective way to 
achieve a correction unless this line of responsibility is assiduously 
followed. 

Some anomolies that were reported last fall by the OCD monitors 
could have been corrected in a timely manner if the above procedure had 
been followed. Also, some comments by the OCD monitors were at variance 
with procedures established one and two years previously in Head Start 
and Follow Through. This brings into focus the need for all monitors 
thoroughly to Xn;>w the prescribed procedures. 

Finally > the efforts being applied to support and insure the data 
quality of the spring testing for the PV Evaluation are without prece- 
dence. Certainly this concern and concentrated effort cannot other than 
establish a new standard for nationwide testing control and accounting. 
The decisions made by the Review Panel last November resulted in a very 
substantial increase in the effective support— -and demand-- for the best 
quality of data emanating from the Head Start Planned Variation Evalu- 
ation project. 
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Table 1 

HEAD START PLANNED VARIATION SPRING 1972 SITE COORDINATORS' TRAINING SESSION fc TESTING SCHHDUjuK 
Head Start Conununitles S(L 



1971-72 



SPONSOK 



(•o;)r 



roMMi'MTY 




Nimaicht 



Tiic^nn 



iiufi nio 




J Vl^ Mt>inr.s(FT) 
I.i tu'til n 



II I 

nj 
I fi 



Bank 
Street 



05 , m 
05ri2 



Jimiljlor 



WiJmAn^tt>n, . 



Eng 1 c- 
mann & 
Becker 



1)7 . IJ 

07~rri 

iT — 



jru£elj>_ 
r:,LaffVeR aSy N M 

Provificnco^PT) 



nj 

fjJ. 

fl I 
n r 




„r/J.-=J^/l^/^:a::„:^^^:^ 



x^i_r.r/Ay/» 



Buaholl 



08.02 



Oraibi 



I 



08 

ohToh 



P ortaKe vil le 
Mound!;." IhT" 



III 

m 



Weikart 



00.02 



Ft. Walton Bch 



09.04 

oo.'oe 

oaJYo 



C entra l Oz. 
fireel oy 
Seattle 



ffl 
iTf 



Gordon 



10.01 



jJ).J)2 
ro.J07 
10.10 



J acksonville 

^hviip^y^strsi 

Chatta nooga 
Houston 



I 

iTr 



III 



i 



EDC 



n .05 



11 .OB 



Pa tor son 

JohnHtnn Cn. 



Pltts- 



12.03 



REC 



12.04 



l.ock Haven 
Montrvldeo 



Kansas City 



2fi.01 



St .Thomas. VI 




J 



Enablers 



27.0 1 



27^02 



27.03 
27.01 



Puert o Rico 

N'ewburgh ^ 

jTel_l_ows Jhja^ns 

Colorado So 



I 



III 
111 



Ill 



JX^. 



Controls 



Huntsvlllx-'^Ala. 



San Jose,Cal . 
SacramentOyCaV, 



8 Level I Sites 
30 Level 11.1 Sites 



*Note: In Patorsnn, classos o>Crer 2ri children are considered 
pqtial to two classes. 
In Hollows Falls, a rail-tested class was made into 
two classes. 

In Providence, fall testing: only (lor 8 classes). 
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MEMO 



TO. 



Head Start Directors 



OATE: 3/1/72 



FROM; 



Tor Meeland 



LOCATION: 



SUBJ6CT; Spring 1972 Testing 



CC: 



Ref : 



H&-445 



I wish It was possible to hold another meeting at SRI such as wg 
had last summer, for the final preparations of the spring testing. The 
advice and support you gave us all was the fundamental reason for the 
relative ease with which the fall work was accomplished. 

Here, briefly, are the spring plans: 

Site Coordinator Meetings will be held at SRI In two sessions 
(March 20-24 and April 10-14) to permit more Individual attention to be 
given. Table 1 shows the present plans concerning which Site Coordinators 
will attend each meeting. 

Test Battery . Consistent with the plans laid last summer, OCD h«R 
added two tests to the battery: Gump-gookles (used for several yc:^vri 
In early childhood testing) and Relevant Redundant Cues (sometimes 
referred to as Zings and PogglesI). The former will be given to all 
tested children and the latter added to the Supplemental Battery (given 
to 1/3 of each tested class). 

The testing will consist of two Basic Batteries for each child 
previously tested and a Supplemental Battery given to each child who 
previously took the Supplemental Battery. 



The 8-Block Sort Task will be given to each child and mother tested 
ITl the f^all, but only In those sites that had Class Observations plus 
Jonesboro and Houston along with a readmlnistratlon of the Parent = Inform- 
ation Form. (The reduction In sites was due to budgetary limits.) Again, 
the mother will be given a $5 honorarium to defray her baby sitting and 
possible Job-Income loss. 

Only children previously testjed will get tests this spring, but If 
this leaves only one or two class'^ members who came to the class after 
the fall tests, some tests should be given to them so they do not feel 
left out of the activities. The 8-Block training session wlltbe held 
at SRI, April 17-21. 

Parent Permission to test the children should be obtained In those 
communities where this Is necessary. The Site Coordinator can provide 
the forms to you. 




Teacher Information Forms will be distributed by the Site Coordin- 
ator (after coordination with you); the completed forms are to be placed 
in envelopes and sealed (the same as with the Parent Information Form), 
Each teacher will receive a $10 honorarium for the extra time she must 
spend in this effort. 

Schaefer Behavior Ratings of children will be made by each teacher 
similar to the fall effort 



Classroom Information Form (CIF) must be completed, i.e., Items 
such as pupil losses and additions, and days absent are to be added 
to the Information given Initially last fall. Fov this help with the 
CIF and Schaefer each teacher will receive a stipend of $20 for her extra efforts. 

Classroom Observations should have been completed by the time the 
testing begins. I hope you can appreciate the extra^^rdlnary isf forts the 
Class Observers made at the SRI training sessl(»ns in order to become 
proficient in the observation procedure. Theix ^^tmpletlon of such an 
intensive training sesslonf> ^.«}eaks Vi^ry hlgsnly of their motivation! 
tfslents and sh^er determir >tion. If you have the opportunity, you should 
ark tlieip. about tholr experiences; I know you will be able to capture ii 
bit of thB excitement of this (Activity. If the Class Observers are v^luc- 
tant to tell yot about their recent classroom experiences, please dor^^t 
blame them beeauSv^ have carefully admonished tbem not to relate class 
activities to anyone biit their trainers at j^RI. 

M ^ad Start Dire ct ors* Information Form . At the fall meeting you all 
seemed unanimous rn"/v>ur request that inquiry be K^de of the directors 
about p't'Ogi^am implementation—to help balance similar reports that are 
obtalued from sponsors and bcD consultants. Mike Smith and his staff at 
Huron Institute have spent a great deal of time and effort preparing the 
form you will receive during April. It*s a long form, b*ai: there are many 
things that Huron Institute needs to '^:now. Please be patient with it 
and try to complete it promptly. 

Ratings of the teachers by Head Start Directors (and Sponsors). 
In a few weeks we will a^rain ask you to rate the performance o^ y J?'ar 
teachers in terms of their implementation of your program or i \ tli^) case 
of comparison ulass teachers, accordliyg to the way they carry out the 
Head Start guidelines for teachers. Again, this is a critical piece of 
information for the PV evaluation njid a prompt response will Aelp us 
to provide information to Huron IViCtltute in a timely manner to expedite 
their analyses of PV. A similar forst in sent to the sponsors for an 
assessment of PV teachers from their point of viev^ ?LSA3E, don*t dis- 
cuss the ratings with the sponso^-'S or their represontatives prior to com-* 
pleting them—otherwise, we have nothing but data Contamination I 
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Data Security , For the past two and one hall' years in tho PV 
evaluation we have been very successful in maintaining the confidentiality 
of all the data collected. Many of our procedures are geared to this 
important issue. The names of teachers, children, indeed communities, 
are systematically submerged* The first year report by SRI completely 
camouflaged the IDs; Huron Institute will continue this policy set by 
OCD. 

SRI Field Monitoring 

At the OCD Review Panel Meeting in December 1971, there was full 
agreement that SRI should increase its efforts in monitoring the local 
site training and testing activities. This decision was made with full 
consideration of the additional cost and effort required. Members of 
the project team will spend a minimum of five days in each community 
(2-3 days during training and 2-3 days during testing) to provide a 
second level of supervision and support of the Site Coordinators. In 
special cases such as sites with new Site Coordinators, we will plan to 
be present during all of the tester training period to give whatever 
support and counsel is needed. If we feel, or you request it, we will 
arrange for more extended stays. 

The decision of OCD and its review panel to support such an exten- 
sive effort clearly points out the emphasis that is being placed on the 
quality control aspect of the data collection. 

The project member(s) who come to your community are there to work, 
not to be critics; the more reliably the data are gathered, the stronger 
will be the PV evaluation. Personally I feel this is a remarkable mile- 
stone for OCD; it clearly demonstrates a willingness to make a large 
investment to support a critical quality control effort. (I don*t 
envy Klara Evans who has to schedule each of us In an efficient way to 
all 30 sites.) 

Testing Dates 

Also as a result of concurrance of the OCD Review Panel, we are able 
to schedule testing dates to permit the field monitoring to occur as 
described above. We considered your Head Start closing date, public school 
closing (because a prior closing of public schools sometimes reduces 
Head Start attendance) and the travel itineraries of the project staff. 
Table i shows the period of testing we have planned for each community. 
If recent events indicate the dates should be changed, PLEASE CALL 
Klara Evans immediately so she can made the necessary changes (and face 
the wrath of the staff members who are accommodating to the travel 
•requirements ! ) . 
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The testing period varies with each site depending on the experience 
from last fall« The availability of testers and testing space determines 
the time needed to accomplish the testing in the time shown. One primary 
rule was to avoid testing during the last week of class (teachers have 
too much to do at that time) and in addition, to have all testing com- 
pleted by June 1 in order to prepare the test data for Huron in a timely 
manner, ' 

Postscript , Just an indication that the project staff is being 
kept fully occupied with preparation for the spring testing: in addition 
to the usual rush of preparing forms, procedures, test kits, shipping 
plans and schedules, Klara has scheduled a full scale dress rehearsal 
of all testing procedures by the staff prior to the Site Coordinators* 
meetings. 

P.P.S, All of us look forward to our visits this spring; the 
enthusiasm and excitement we witness in each of the sites makes the 
incipient tedium of the logistical efforts associated with a national 
evaluation wane— »you have all stimulated more than you realize. 

Finally ^ If you have any questions or problems about the spring 
testing, please call me (collect) at (415) 326-6200, extension 2682 or 
Klara Bvans at extension 2517. 
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Table 1 



HKAU START PLAMNBO VARIATION SPRING 1972 SITE COORDINATORS' TRAINING SESSION li TESTING SCHEDULE 

Head Start Coninunltles SC. 
1971-72 



ERIC 



Nliinicht 



02,02 
02.^9 



TiicHon 



-O.vL-JHI 
oil . I i\ 



Bank 
Street 



05 ,"12 



Engle- 
mann k 
Becker 



BusUelT' 



Welkart 



Gordon 



o:<7oH 



07.11 



08.03 



08.qi 
obTob 



09.02 



09.04 



09.06 



10.01 



10.02 



10.07 




HiifUlo 



Oiiluth 



.Salt lAke 



IVb Mi> inoyy r) 



or 



Tu £e l<> 



Vro V i denccCPr ) 



O raib l 

^ )rtaKevill e 
Mounds. 111. 



Ft .Walton Uch 



Central Oz, 



Gr eeley 



ttli 



Jackson vi lie 



Joneshoro 



Chat ta nooga 

Houston 



Pltts- 



REC 



Lock Haven 
Mohtevideo 



IJj" 
Ml 



ill 

m 
in 




- .1 

rrr 



n 1 
fn 
iTf 
iif 



I 



III 

iTi 



III 
iTi 



III 



I 



ffi 
fiT 
iTi 



Enablers 
* 



26.01 



27.01 



27^02 
27^03 
27.04 



Kanwas Ctty 



Puert o Rico 
We wbunch . 

jI«Ll»w§J!l9.U.'i 



III 



III 



LU 



Controls 



Huntsvl lies Ala. 



San Jose^Cal . 
Sacramento «Cal . 



X4 



jA-j£lix/!iA 











^^^^ 



2a. 



8 Level I Sites' 
30 Level III Sltcn 



* Note: In Patcrson, classos over 25 children are considered 

iHjual to two classes. [ 
In Bellows Kails, a rall-tostrd class was made into | 
two classes. \ 
In Providence, fall testing only (for 8 classes). 
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^SfTANFORD RESEARCH INSTITUTE 
MENLO PARK, CALIFORNIA 94025 
<415) 326-6200 



I 



■3 



To: Head Start Site Coordinators 

From: C. P. McCarty 
Subject: Letter of Understanding. 



Date: March 29, 1972 



Hcf : IIS-462 



During the training (session last week 1 mentioned the letter oT under- 
standing which we had hoped to have you sign before you left Menlo Park. Unfor- 
tunately we didn*t quite finish it in time. The letter (attached), althou^^h 
legalistic in appearance, is not a contract. We simply thought it would bo 
helpful for both of us to agree on our mutual responsibilities for the spring 
testing per^iod. If it appears that you may have to exceed the maximum number 
of weeks listed for recruiting, training, and testing, please call Klara Evuns 
before you go over the limit so that we can plan accordingly. 

Please return one copy to us after you have signed it. The second copy 
is for your files. 



Thank you. 




CFMcCrkfb 



Attachments (2) 



F-19 



CABLE: STANRE8« MENLO PARK / TWX 910-373-1246 



'3 



«2 



STANFORD RESEARCH INSTITUTE 
MENLO PARK, CALIFORNIA 94026 
(416) 326-6300 



iire are pleased that you have agreed to act as a Site Coordinator 
fov the Head Stiart Planned Variation Evaluation which Stanford Research 
Institute is conducting in • 

Period of Work 

It is understood that your services will be required during the 
period through . as follows: 

1) Five days for Site Coordinator training in Menlo Park, California 
and 

2) a maximua of weeks for recruiting, training, and testing. 



Nature of the Work 

At the training session in Henlo Park, you will be instructed in 
the various spring test batteries which you will subsequently train 
the testers in you community to administer. 

Materials required for all the tests will be. shipped to you well in 
advance of th^ start of testing which in is scheduled 

to continue for weeks, i.e., from to . 

You will be expected to provide full-* time services during the period 
of testing. 

Confidentiality of the Data 

The data collected and the information gathered during the period 
of testing are restricted. They cannot be divulged to anyone other 
thari SRI Head Start project personnel. 
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CABLE:* STANRES, MENLO PARK / TWX 910-373-1346 



stipends y Pay and Expenses 

You will receive a training stipend of S35.00 per day or $175.00 
for the five-day training session in Menlo Park. The Institute will 
arrange and pay for your travel to and from Menlo Park and your hotel 
accomnodations. Your actual living costs during the training session 
will be reinbtirsed according to the Guidelines and Instructions for 
Completing Head Start Invoices . 

The Institute will pay you for your services rendered at the 
rate of $35.00 per day ($5.00 per hour for a maximum of seven hours 
per day). Partial days will be prorated at $5.00 per hour. Your 
allowable expenses, will b^ covered as described in the Guidelines . 

Per purposes of identification you are assigned No. HC which 

should be included on invoices, reporting forms, and correspondence. 

Pay Procedures 

You will be expected to submit once each week (preferably on 
Friday) your invoice for services plus receipts as appropriate. 
You can expect payment within three weeks of submission of a 
properly completed invoice. 

If you have any problems or questions, please contact Xlara 
Evans, Supervisor of Head Start Field Operations. Her number is 
(415) 326-6200 extension 2517. 

Very truly yours. 

Tor Meeliand, Pli.D 

Senior Research Psychologist 

Project Leader 

Head Start Planned Variation Evaluation 
I agree to the stipulations stated above. 



(signed) (date) 

(Please sign and return on^ copy. of this letter to SRI in the enclosed 
envelope as soon as possible. The second copy is for your files.) 
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The Record 
FROM: Tor Meeland 



SUBJECT; 27 Item Version of Giimpicookies 
to be Used In HSPV, Spring 1972 



DATE: 3/28/72 

LOCATION: 

CC: 

Ref : HS-4CiO 



To reduce the test time for Guropgookies, (which was almost 30 
minutes for the administration of the 60 itom ETS version) Mike Smith, 
Esther Kresh, Klara Evans , and I agreed to a shortened version of 30 
items maximum. Alternatively, the testing would require a new ^'battery'* 
and extra testing/training costs. Vickie Shlpman and Dorothy Adklns 
both stated the test could be done In twelve minutes, but Esther and 
Jane Stalllngs could only read the 60 Items In 12 minutes without 
scoring or waiting for a child's response. 

Mike* 8 first preference was to select Items on the basis of item- 
score blserlal correlations. Dorothy Adklns (whom I later talked to on 
Mlke*s behalf) felt this was a poor criterion due to the item difficulty 
levels that seem to bo Influenced by response set. Using a current 
factor analysis of 1800 four-five year olds, she identified 27 Items 
(covering four factors) that had the highest loadings. The fifth factor 
was Ignored because the factor seemed to .lump around In the spilt 
factoring she had done. 

Adklns. uses a total score (on the 75 Item version) for four year 
olds. Mike on the other hand felt unsure what a total score would repre- 
sent . 

The following Items were selected for the spring *72 form: 



Factor 1 

Instantaneous 
Activity 

Adklns ETS 



Factor 2 

School 
Enjoyment 



Factor 3 

Self 
Evaluation 



Factor 4 

Purposive 
Behavior or 
Purposlveness 



Adklns ETS Adklns 



ETS 



AdkliTs 



ETS 



ItemNa ItemNa ItemNa ItemNa ItemNa ItemNa ItemNa ItemNa 



31* 


16 


9 


2fi 


16 


38 


1 


19 


57 


60 


45* 


12 


10 


17 


25 


20 


5 


8 


60 


na 


52* 


5 


14 


14 


28 


25 


6 


21 


71 


47 


53* 


33 


19 


36 


42 


27 


8 


50 


3 


29 


54* 


41 


58 


9 


49 


7 


13 


37 


55 


15 


56* 


24 


61 


22 


50 


54 


17 


53 


33 


na 


59* 


56 


48 


na 


46 


na 


18 


58 






68* 


48 






47 


na 











30* 
26 
40 
66 

67 
99 



na 
49 
28 
69 

10 
na 



*lofi(llng over .40 



!• act or 5 

Sdf- 
Conf Idencc 
(not used) 

Adklns ETS 
ItemNa ItemNa 



.2*5 



A more convenient list ol the 27 iloms to bo used out ol the trJ 
60 item booklet follows: 



5 


20 


37 


7 


21 


38 


8 


22 


41 


9 


24 


48 


12 


25 


50 


14 


26 


53 


16 


27 


54 


17 


33 


56 


19 


36 


58 



N « 27 
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MEMO 



TO: Site Coordinators 
FROM: Romalne L. Mason 

SUBJECT: Spring 1972 "Tests to be Admlnxstored* 



OAT6; 3-28-72 

LOCATION: 203B 
CC: 



The Class Lists that you hsivc received designate the tests that each child 
should receive for Spring 1972 testing. 

Please be sure to go over the following Instructions In the use of the Class 
Lists with your testers as they are very Important to our processing procedures. 

IMPORTANT : The Class Lists will replace the Record of Children 
Tested (used In the Fall), which was crucial to our 
processing. Therefore, please follow these Instruc- 
tions carefully and do not make any notations other 
than those stipulated below. 

INSTRUCTIONS 

1. Each tester should have a List for the class In which he will be testing?. 
The tester should write his name In the space provided on each List he uses. 

2. Only give a child those tests assigned to him on the List. 

3. If for any reason a child cannot be tested, do not test another child In his 
place. 

4. Occasionally letters of a child* s name had to be dropped for processing pur- 
poses. Therefore do not add letters to any of the children's names. However, 
If a child's name has been changed legally (adoption, remarriage of mother, 
etc.), please make the correction. 

5. After you have administered a test, circle the asterisk under the name of the 
test to keep an accurate account of tests administered. 

6. If you could not administer a test, write in your reason next to the child's 
name In the space provided* Please draw lines separating the children's names, 
so that your comments do not flow Into the space allotted to the next child. 

If you need additional room, turn the sheet over and write both the Seq . no. 
and the no. and continue your explanation. 

NOTE ; Any other comments concerning the administration of 
tests should be written In your logs. 

7. New children must be added to the Class List and should be given only the 
Schaefer Behavior Inventory. Add them to the bottom of the List and give 
them the next Seq. nos. after the last child on the List. In some cases a 
second sheet has been provided if the first sheet ended with Seq. no. twenty 
(20). If the' second sheet has not been provided, continue on the first sheet 
to Seq. no. twenty (20), then turn the sheet over and continue the sequential 
numbering from twenty one (21) on7 

8. An **X** next to th'evteacher's name indicates a non-tested class. All children 
m non-tested classes will ONLY receive the Schaefer Behuvior Inventory. 




MEMO 



TO; 

FROM: 
SUBJECT: 



OCD Monitors ol the Head Start PV 
Evaluation Testing^ Spring '72 

Tor Meeland ^p^^^i^^''^ 

Procedures, Manuals , Score Forms and 
Quizzes Used for the Spring Testing 



DATE: March 30, 1972 

LOCATION: 
CC: 

Ref : HS-464 



To assist you in preparing for your Motiitorlng Tasks, I enclose copies 
of the following: 

Manual/ 

Instruc- Score Tester Ans, to 
t ions Form Quiz Quiz 



Guidelines for Test Administration 

WRAT 

Basic Battery - A 

Gumpgookles 



Basic Battery - B 



Supplemental 
Battery 



PPVT 
PSI 

Enumeration 

' Relevant Redundant Cues 
(Zings and Poggles) 

Motor Inhibition (MI) 

ITPA 

Brown IDS 



(Yellow) 
(beige) 

(Canary) 

(Green) 
(White) 
(Blue) 

(Orange) 

(Orchid) 
(Pink) 
(Mu stard) 



* 



* 



Attached is a copy of the Guidllnes for Administering Tests in Spring *72 
(Blue) . It shows the test composition for each Test Battery, 

Your procedure guidelines and recording forms will come from OCD or Mike 
Smith, Huron Institute, Cambridge, Mass. 

If you have any questions about the test administration instructions or 
score fomiSt & form was left out of your package, please call me at 

(415) 326-6200 ext. 2682. 

Tor Meeland, Ph.D 
Sr. Research Psychologist 
Mgr.^ Head Start PV Evaluation 
^ Project ^ 



ERIC, 
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MEMO 



TO: 



Doris Wallace 



date: 4/5/72 



FROM: 



Tor Meeland '~7Jj^v 
Klara Evans .jir-t 



KC 

OCD Monitoring of Head Start 



LOCATION: 



SUBJECT: 



CC: 



Planned Variation Sites 



Lois-ellin Datta has informed us that you will be visiting three 
Head Start Planned Variation sites as an OCD Monitor this spring. Listoti 
below are the Head Start Directors and our Site Coordinators for each 
community for your advance contacts:. 

Bellows Falls, Vermont ; 

Ann Raynolds, HSD 
57 Furnace Street 
Springfield, Vt. 05156 
(802) 885-2148 

James Mack, SRI Site Coordinator 
P.O. Box 6 

Springfield, Vt. 05156 
(802) 885-2766 - office 
(802) 885-3263 - home 

Wilmington, Delaware ; 

Willis B. McLeod, HSD 
625 E. 10th Street 
Wilmington, Del, 19801 
(302) 654-3181 

Judith Bamett, SRI Site Coordinator 
^2225 Elder Dr. 
Paul kl and Heights 
Wilmington, Del. 19808 
(302) 994-4146 

Pater son. New Jersey : 

Cecile Dickey, HSD . 
236 Broadway 
Paterson, N.J. 07522 
(201) 271-3344 

BUI Shipp, SRI Site Coordinator 

86 17th Avenue 

Paterson, N. J. 07011 

(201) 523-8308 or 523-5255 - office 

(201) 742-8311 - home 
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MEMO 



TO: 



FROM: 



SUBJECT: 



Wally Hennlng 



Tor Meeland 
Klara Evans 



OCD Monitoring of Head Start 
Planned Variation Sites 



OATE4/5/72 

LOCATION: 

CC: 

Ref ; HS-470 



Lols-ellln Datta has Informed us that you will be visiting three 
Head Start Planned Variation sites as an OCD Monitor this spring. Listed 
below are the Head Start Directors and our Site Coordinators for each 
community for your advance contacts: 

Jonesboro, Arkansas ; 

E. Boone Watson , HSD 
P.O. Box 1343 
Jonesboro, Arkansas 72401 
(501) 935-8610 

Beverly Richards, SRI Site Coordinator 
1803 Wofford 
Jonesboro, Ark. 72401 
(501) 932-4264 

Chattanooga, Tennessee ; 

Frieda G. Mai one » HSD 
1161 W. 40th Street 
Chattanooga, Tenn. 37409 
(615) 821-2513 

Jeanne Abbott, SRI Site Coordinator 
752 Emory Drive 
Chattanooga, Tenn. 37415 
(615) 875-3587 

Des Moines, Iowa ; 

Harrlette Bruce, HSD 
1800 Grand Avenue 
-Des Moines, Iowa 50309 
(515) 284-7728 

Royal Corbln, SRI Site Coordinator 

418 E* Holcomb 

Des Moines, Iowa 50313 

(515) 280-1984 



ierIc 
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MEMO 



TO: 



Robert Rentfrow 



DATE: 4/5/72 



SUBJECT 



PROM: 



Tor Meeland "T^*" — ' 
Klara Evans ^^ii 

OCD Monitoring of Head Start 
Planned Variation Sites 



LOCATION. 



Ref; HS-471 



Lbis-ellin Datta has informed us that you will be visiting throe 
Head Start Planned Variation sites as an OCD Monitor this spring. Listed 
below are the Head Start Directors and our Site Coordinators for each 
community for your advance contacts: 

Houston t Texas ; 

A. B. Leonard, HSD 
6300 Bowling Green 
Houston, Texas 77021 
(713) 748-*4410 

Bnma Jean Jones, SRI Site Coordinator 

10759 Dulcimer Street 

Houston, Texas 77051 

(713) 528-0611, ext. 260 - office 

(713) 734-*29i2 - home 

Greeley, (Colorado ! 

Linda See, HSD 
811 15th Street 
Greeley, (Colorado 80631 
(303) 352-* 1543 

Joe Good, SRI Site (coordinator 

1851 23rd Avenue Ct. 

Greeley, Colorado 80631 

(303) 352-*1543, es^tenslon 52 - office 

(303) 353-4868 - home 

Ft, Walton BeacH Florida ; 

Sharon Ryan, HSD 

23 Wright Parkway, S.W. 

Ft . Walton Beach, Fla. 32548 

(904) 243-*8415 

Patricia Werth, SRI Site Coordinator 
212 Beachview Drive 
Ft. Walton Beach, Fla. 32548 
(904) 242-9195 
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TO: 



FROM: 



SUBJECT: 



DennlH Dolorla 



Tor Mecland 
Kiara EvanH 



OG) Monitoring of Ileud .Start 
Planned Variation Sites 



MEMO 



OATF 4/17/72 

tOCATION 

CC 

Rcf : HS*477 



•4 

-'0 



I^>l8-e111n Datta h:iH inronnccl us that you will ho vlnltluK throe 
Head Start Planned Variation sltos as an CCD Monitor this spring:* Iilstod 
below are the Hoad Start. Directors and our Site Coordinators Tor each 
community for your advance contacts: 

Lincoln , Nebraska ; 

Shlrlle Hutcherson, HSD 
225 South 25th 
Elliot School 
Lincoln, Nebr. 6H510 
(402Tr 475-8329 (off.) 
(402) 434-7979 (home) 

R(>bert Uucknor, UHl Site Coordinator 
7811 Sandalwood Drive 
Lincoln, Nebraska 68510 
(402) 475-8327 
(402) 488-5634 



Lock Haveiy Pennsylvania : 

Eleanor Zimmerman » H.SD 
Penn Center 

110 E. Dald Eagle Street 
Lock Haven 9 Pa. 17745 
(717) 748-5107 

Margaret Schwarz^ SRI Site Coordinator 
699 James Street 
Flemlngton^ Pa. 17745 
(717) 748-5801 

Colorado Springs, Colorado ; 

Juan Padres t HSD 

Pikes Peak CAP, Inc. 

9E Castllla Street 

Colorado Springs , Colorado 80903 
(303) 635-1536 * 

Carolina Shankt SRI Site Coordinator 
519 W. San Miguel 
Colorado Springs ^ Colo. 80905 
(303) 632-3086 



ERIC^ 
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MEMO 



FROM: 



Liz Raymer 

Tor Meoland 
Klara Evans 



OATt 4/17/72 



I OCATION 



SUBJECT: 



CCD Monitoring of Head Start 
Planned Variation Sites 



CC: 



Ref : HS-478 



Lols-*ellln Datta has Informed us that you will bo vl.sltlng three 
Head Start Planned Variation sites as an OCD Monitor this spring. Listed 
below are the Head Start Directors and our Site Coordinators Tor each 
community for your advance contacts: 

Dulut!\ Minnesota ; 

T. V. Churchill, HSD 
4211 Lombard Street 
Duluth, Minn. 55804 
(218) 624-5715 (off.) 
(218) 525-t237 (home) 

Kathleen Kelly, SRI Site Coordinator 
4760 London Road 
Duluth, Minn. 55804 
(218) 525-5111 

Salt Lake City, Utah; 

Nancy Abraham, HSD 
1240 American Beauty Drive 
Salt Lake City, Utah 84116 
(801) 187-36-11 

Mary Jo Klelnschmldt, SRI Site Coordinator . 

3170 East 3900 South 

Salt Lake City, Utah 84117 

(801) 277-2133 

Tacoma, Washington; 

James Robert on, HSD 
P. 0. Box 1357 
Tacoina, Wash. 99201 
(206) 3R3**1B!1, ext. 420 

Ramonn Wolfo, SRI Site Coordinator 
1329 Kast OBth Street 
Tocoma, Wash. 98408 
(206) 474-1209 
(206) FU3-1811 
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Attached 1h T<»stln>? ami Kiolcl Supervisors' .S*<*hf*clu] <• that Ixsts 
by community the tostiiiR datos^ tlu* SiU Fiold Siiporvisnrs assif;ne<i Ut 
oacli site and thv dates oi' iliolr slto visits. Harrinu any unforcs^jon 
events, you may wi>rk mil your schodulo annind <Mir prf;;ent plans. Plcaso 
keep In mind that our world nover remains static l<>r lon«, so be cer- 
tain to double chock with our 5Jito CoordinatDrs shortly before your 
arrival for any possibU* ohanf;os. 

In the evont you fjiul any discr<*pancios in tost promlures, etc, 
you may contact elthor nl us by calling; collect (115) n2(>-()200t cxtonsion 
2C82 frir Tor or extension 2517 for Klara. It is vital 1i> the success 
of the Head Start Planned Variation cvaIu9.tion that you contact us in 
the above mentioned evei^ts immediately so that we may rectify any mlj4- 
understanding as soon as possible. 



liAII. 4/4/72 



HEAD START PLANNED VARIATKM - Spring '72 
Testing and Field Supervisors' Schedule 



lleuti Stsirt. Cummtiniiies 
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Te^tlnff 


SRI Field Supervisor 


Dates FS 
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roMMUMTV 






DAtes 


(Nsl4) 


on Site 


Nlmnlchi 




Htifl alo 




I 












Dultith 


m 


5i^«^2'4 


Georsrla Glllis 


5/4-10 




oV.09 


Salt l«akG 


u 


4/24-5/12 




4/20-26 




02 




Tacoma 




I 




Kathv Fl*eeca 


' ""4/27-5/3 


Tucson 






1 1 


4/28-5/18 


Jean Lotrldj^e 


4^24-5^3 * 








liaFay<'M<^ .. - 




5/1-16 


Beckv S Inons 


4/27-5/3*"^" 




IKS 




• 11 


5A6-6/5 


Romalne Mason 


5/12-18 




o:; 




Li ncNi 1 n 


1 1 1 


5 A -16 


Merril Lynn Beers 


f7.""4/28--5/4' 


Rank 
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Strrt*t 






Tuskt;^CH> _ _^ 


-LI 


4/27-5/11 


Romalne 


4725^28 




05 
()5 


.11 


Wilmincton 




S/ft-25 

Q— Aw 




5/4-10"" 




.12 


Klmira 


1 rr 




Paotcpv NaimII as 


5/4-10 


Enf( 1 c- 


07 


.11 


Tupelo 


Ml 


5/S-26 


Rlanrar et Carrol 1 


5/1-10 ♦ 


mann Ik 


07.14 


K, La8Vogas,?4M 
PrnvidcnceOT) 




4/1 Q-iS/d 

XV— »#/ w 


Kftf* An Afielt4 nl 


4yi7-21 


Bockcr 


II 






5/4-10 


07 


.19 










Bushel 1 


OK. 02 


Oraibi 












OK. 01 


Portarovllle 


II I 


4/17-5/5 


Georffla^^ 


4/10-19 




OK. OK 


Mounds. 111. 


II 


4/26-5/12 

Aw / Xwi 


' Merril Lvnn 


4/24-27 


Welkart 


00.02 


Ft. Walton Uch 


III 


5/10-26 


•Taak 


5/4-12 ♦ 




09. q4 


Central Oz. 


11 


4 /5-1 9 

"m/ X» 


Sfinriv Mtit*nhv 


4/3-6 




09.06 


Grceloy 


If 


»#/ w Xw 


Kfiren 


5/1-5 






. 10 


Seattle 


1 








Gordon 


10.01 


Jacksonville 


I 










MHO. 02 


Joncshoro 


L II 


4 y9A«i<> /I A 
. ^/ aO— u/ XD 


aaz^en 


4/24-28 

*S/ A*S AO 




10.07 


Chat tanooga 


II 






4/94M9fl 




10.10 


Houston 


II 


A yOT R /I T 




A yoi -.R /A 


EDC 


11.05 


Washington 


I 








1/ 


11.06 


Patcrson 


III 




Tama CI^aI t 


«4/11-17 




U 


.08 


Johnston Co. 


I 1 


4/2^-5712 


Beckv 


4/20-26 


Pltts- 


12.03 


Lock Haven 


III 


5/l-l» 


Peffflpv 


4/^7^5/3 




12 


;04 


Montevideo 


TI 


4/iftls/a 




4/JL4-_2D 


REC 


20 


,01 


Kansas Citv 


11 


4/1 n-R/Tf 


Sandy 


4/7-13 


N.Y jr. 


26 


,pl 


St. Thomas. VI 


J 








Enablors 


27 


,01 


Puerto Rico 


I 










27 


.02 


Newburi^h 


11 


5/8-26 


Romaine 


5/1-11 * 






JJeUows JhloUs 
Biffln^s" 


..LI 


4/24-5/12 


Peggy 


4/20-26 


27"r04 


11 


5/1-19 


Georgia 


4/27-5/3 _ 




27 


.05 


Colorado Su 


1 I 


5/15-6/2 


Kathv 


5/11-17 










Controls 




• lluntsviiJe;Ala. 


5A5-6/2 


Sylvia Jeans 


5/10-16 






San J.ose,Cal. 


5/22-6/9 


Sylvia 


5/18-24 








>>>acrainento , Cal 


• 


5/29-6/16 , 


^/Sylvia . 


5/25-31 



8 Lovol 1 Sites 

30 Level III Sites i/Note: In Paterson, classes over- 25 children are considered 

equal to twn classes. 
^. a fall-tested class was made into 

Providence, =.'tat 




MEMO 



TO: Head Start Directors date: 4/12/72 

FROM: Tor Meeland location: 

SUBJECT: Dlrectors * Evaluation of Model cc: 

and Implementation Report ^^^^ HS-474 



You may recall that at the Head Start Directors* meeting at SRI 
last August 9 there was a fairly common desire on the part of the 
Directors present to have an opportunity to comment on the models and 
related Issues of Implementation, 

Huron Institute has developed a form for the systematic collection 
of your Ideas and evaluations. The enclosed form represents a great 
deal of effort by Hike Smith and his staff at Huron Institute, It 
Includes 9 among other things, questions and topics culled from consul- 
tant reports and other sources. As you can note^ It Is a very compre- 
hensive form. 

Please take the time to complete this Directors* Evaluation of 
Model and Implementation Report and return It to me by May 1, 1972, 
There Is a glossary on page 2 to assist In keeping the terminology 
clear. 



r 



f 

i 




INFO 
COPY 



TO: 

PROM: 

SUBJECT: 



PV Evaluation Head Start Directors 

Tor Meeland 

Appreciation 



MEMO 

OATE: June 19, 1972 

LOCATION: 
CC: 

HS-509 



The third and final year of data collection for the PV Evaluation Is now done. It 
has been a very busy period. Without the splendid and continuous support each of you 
gave to us, the testing program could not have been completed so successfully. The 
-patience, counsel, and accommodations you extended to us were remarkable. 

Aside from the many cherished meetings we all had with you, the most satisfying 
feature of the work was the extensive use that was made of the community paraprofesslonals 
In the data collection effort. Due to your coordinating efforts we were able to assemble, 
train and effectively use hundreds of local persons. 

Please extend our appreciation to your teachers and aides who gave such generous 
support to the field stiuCf during the testing. Without their help it would have been 
impossible to test without undue commotion. 

If in your future travels you come close to Menlo Park, please come in and see us 
ag^ln. ' We all would enjoy such a meeting. 
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Appendix G 

SUPPLEMENTAL INSTRUCTIONS FOR FIELD STAFF, SPRING 1971 



Appendix G 



SUPPLEMENTAL INSTRUCTIONS FOR FIEIJ) STAFF, SPRING 1971 

CONTENTS 

Level I Site Coordinator - General Instructions 

Level II Site Coordinator - General Instructions 

Level III Site Coordinator - General Instructions 

General Instructions -^Auxiliary Batt<?ry Testers 
Checklist for Blnet Testers 



I£VEL I SITE COORDINATOR - GENERAL INSTRUCTI(»(S 



Materials in this package: (all should be returned) 

1. Print-out of the children in the class (example attached). 

2. Print-out of the Classroom Information Form from Fall 1970, 
plus the instruction sheets. 

3. CPSC's (California Pre-School Social Competency Scale) BLANK - 
for the teacher to fill out for each child on the class print- 
out and any additional child now enrolled in the Head Start 
class and an instruction sheet for each teacher to use with 
CPSC^s. 

1. Class Print-out: 

a. This is a list of the children enrolled in each class in the Fall of 1970. 
The teacher should use this list when filling out the CPSC's to be sure 
she either has completed a form tor each child on the print-out or can 
write an explanation next to the child* s name as to why there is no form 
for this chlldi (i.e., child left class). Disregard asterisks under CPSC 
heading - this designated children who received CPSC*s in Fall 1970. 

2. Print-out of Fall 1970 Classroom Information Form: 

a. This computer print-out shop;s what data from the Classroom Information Form 
that was completed last Fall is in the SRI data bank. There may be some 
BLANKS or discrepancies In some of the forms. Please make the necessary 
additions and changes according to the instructions. As Site Coordinator 
you are to see to It that these forms are completed as best possible before 
returning them to SRI. ^ 

b. > The teacher Is probably the best source of information. There are some 

additional questions in this form that were not present on the Fall 1970 
Form. . In this case, the questions must be answered for each child. If 
any new, children are added to the class, the names must be added to the 
bottom of the list and ALL questions (1 through 18) answered for each child 
as In the Fall. It Is most Important that the Classroom Information Form 
Is fully completed or missing data explained. Refer to the Instructions for 
further explanation on how to fill out the form properly. 

c 

3. California Pre-School Social Competency Scale (CPSC) 

a. These are the same forms filled out by the teacher In the Fall. She is to 
fill out a form for each child presently in her class according to the pro- 
cedure given on the instruction sheet. (This Includes the children from the 
Fall who are still in her class and any new children who have entered her 
class.) The teacher does not fill out CPSC*s (California Pre-School Social 
Competency Scale) for children who have left her class prior to April 1, 1971. 
If anyone other than the teacher fills out one or more CPSC*8| her name and 
title must be entered In the space "Rated 1^". However , please make every 
effort to get CPSC* s done by the teacher.. 



LEVEL II SITE COORDINATOR - GENERAL INSTRUCTIONS 



Class Print"OUt (see example attached): 

a. This is a random order list of the children enrolled in each class in the 
Fall of 1970 and shows the tests they took. The children must be tested 
in the order on the print-out — that is from the top of the print-out , to 
the bottom (column labled SEQ No), If a child is absent or has left the 
class, then you may go to the next child on the list. DO NOT SKIP AROUND 
PICKING ANY CHIU) TO TEST EACH DAY. You must keep to the list. Pick up 
absent children on the first day they return, if you are still at the 
center. In the event you have finished at a particular center, but have 
missed a few children due to absences and you have time at the end of 

the test period (three weeks - no more) go back to the centers and test 
the children missed due to absences. 

b. You will receive 3 copies of the class print-out for your use. Give eacfi^ 
teacher a copy of her class print-out. This print-out shows the children 
we know to have been in her Head Start class in the Fall of 1970, and for 
whom she must fill out a CPSC. She should list new children on the print-out 
(and complete CPSC's for them, also). If a child is no longer in her class 
she should explain why. You should keep one copy for yourself and make 
corrections of each class accordingly. The third copy is for the use of 
your Auxiliary Battery Testers, but you may feel that one set is insufficient, 
and choose to use your set as well. This is up to you. PLEASE RETURN THE 
PRINT-OUTS TO US, AS THEY ARE HELPFUL IF YOU HAVE MADE ANY NOTES ON THEM. 

c. To determine if a child should receive the Auxiliary Battery Tests, look 
for the asterisks under each test. If there is an asterisk under an^, of 
the Auxiliary Battery tests, the child must be presented with all of the 
Auxiliary Battery Tests. 

d. You will note on the class print-out the following headings: CPSC 
(California Pre-School Social Competency Scale - which ±g to be filled 
out by the teacher); Bk. 3D, Bk. 4A, PSI, and M.I. (this is the Auxiliary 
Battery to be given by the Auxiliary Battery Tester); OCAS (Children's 
Cultural Awareness Scale); EIQ (Ethnic Identity Questionnaire) - IF THE 
HEAD START DIRECTOR HAS APPROVED THE USE OF ONE OR BOTH OF THESE TESTS - 
The Test(s) ^re to be given by the Auxiliary Battery Tester to all children 
who have taken any part of the Auxiliary Battery. 

Print -out of Fall 1970 Classroom Information Form : 

a. This computer print-out shows what data from the Classroom Information Form 
that was completed last Fall is in the SRI data bank. There may be some 
BLANKS or discrepancies in some of the forms. Please make the necessary 
additions and changes according to the instructions. As Site Coordinator 
you are to see to it that these forms are completed as best possible before 
returning them to SRI. 



• >*^''int- out or Fall ^970 Cl assroom Information Form ; (C« >n l i nucd ) 

b. Tho tuucher is probably the best source of information. There are some 
additional questions in this form that were not present on the Fall Form, 
In this case, the questions must be answered for each child. If any new 
children were added to the class, the names must be added to the bottom 
of the list and al 1 questions answered for each child as in the Fall. 
It is most important that the Classroom Information Form is fully complotod 
or missing data explained. Refer to the instructions for further explan- 
ations on how to fill out the form properly. 

3. CPSC*s ( California Pre-School Social Competency Scale ); 

a. These are the same forms filled out by the teacher in the Fall. She is 
to fill out a form for each child in her class according to the procedure 
given on the instruction sheet. This includes the children from the Fall 
who are still in her class and any new children who have entered her class. 
The teacher does not fill out CPSC*8 for children who have left her class 
prior to April 1. 1971. If any one other than the teacher fills out one 
or more CPSC*s her name and title must be entered in the space "Rated by". 
However, please make every effort to get CPSC*s done by the teacher. 
. 

4. Packing Trunks for Return to SRI; 

a. If, when you are packing the completed test materials for return to SRI you 
find you cannot put everything back Into the trunks, then you may discard 
the blank pads of paper and the pictures of the telephone poles. Use the 
packing material (foam) as shown in the packing diagram to prevent damage 
to the trunks. Put the trunk keys In the Site Coordinator Kit. 

b. When you pack to return your materials, please do not mix up forms from 
one class with another. 

5. Testing Supervision ; 

It Is most Important that you carefully check the testing prpcedures during 
the first two days so that you can correct any errors in administration and 
Improve the testing environment If necessary. Try to sit In with each of 
your Auxiliary Battery Testers while she Is testing. Tell your testers at 
the training sessions to expect you to sit In with them at least once during 
their testing for quality control. 

8071-6 
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LEVEL III SITE CCX)RDINATOR - GENERAL INSTRUCTIONS 



Class Print-out (seo example attached): 

a. This Is a random order list of the children enrolled In each class In the 
Fall of 1970 and shows the tests they took. The children must be tested 
In the order on the print-out — that Is from the top of the print-out, to 
the bottom (column labled SEQ No). If a child Is absent or has left the 
class , then you may go to the next child on the list . DO NOT SKIP AROUND 
PICKING ANY CHIU) TO TEST EACH DAY. You must keep to the list. Pick up 
absent children on the first day they return, If you are still at the 
center. In the event you have finished at a particular center, but have 
missed a few children due to absences and you have time at the end of 

the test period (three weeks - no more) go back to the centers and test 
the children missed due to absences. 

b. You will receive 5 copies of the class print-out for your use. Give each 
teacher a copy of her class print-out. This print-out shows the children 
we know to have been In her Head Start class in the Fall of 1970, and for 
whom she must fill out a CPSC. She should list new children on the print-out 
(and complete CPSC*s for them, also). If a child Is no longer in her class 
she should explain why. You should keep one qopy for yourself and make 
corrections of each class accordingly. The other copies are for the use of 
your Auxiliary Battery Testers and the 8-Block Trainer. PLEASE RETURN THE 
PRINT-OOTS TO US, AS THEY ARE HELHFUL IF YOU HAVE MADE ANY NOTES ON THEM. 

c. To determine which tests a child should receive look for the asterisks under 
each test heading. If there is an asterisk under any of the Auxiliary 
Battery tests, the child must be presented with all of the Auxiliary Battery 
tests. If there Is an asterisk under the Stanford Binet - the child Is to 
receive the Bihet (do not substitute the 8-Block for a child scheduled to 
take a Blnet and vice versa). If there Is an asterisk under the 8-Block, 
there will also be an asterisk under the Parent Questionnaire. When the 
8-Block Is given , the Parent Questionnaire must be presented as well. You 
will know (by a previous memo dated April 7, 1971) If your Head Start 
Director has approved the use of the Ethnic Identity Questionnaire and/or 
the ChildSren's Cultural Awareness Scale tests. These tests will be packed 
In your kit according to your Head, Start Director's decision. If one or 
both of the tests have been approved every child who receives an Auxiliary 
Battery should be given the EIQ ard/or CCAS.^ Disregard asterisks under EIQ 
and CCAS headings. 

Print -out of Fall 1970 Classroom Information Form: . 

a. This computer prlnt-^ut shows what data from the Classroom Information Form 
that was completed last Fall is In the SRI data bank. There may be some 
BLANKS or discrepancies In some of the forms. Please make the necessary 
additions and changes according to the Instructions. As Site Coordinator 
you are to see to It that these forms are completed as best possible before 
returning them to SRI. 



^- i*r ini-<Mit. f»r Kai l 1970 (?hissn>om Inl<»n nalU>n Immmii ; (Omthutocl) 

b. The teacher Is probably the best source of inrormalion. There aro some 
additional questions in this form that were not present on the Fall Form. 
In this case, the Piostions must be answered for each child. If any new 
children were add^«d to the class, the names must be added to the bottom 
of the list and all questions answered for each child as in the Fall. 
It is most important that the Classroom Information Form is fully completed 
or missing data explained. Refer to the instructions for further explana- 
tions on how to fill out the form properly. 

3 • CPSC's (California Pre-School Social Competency Scale ) : 

a. These are the same forms filled out by the teacher in the Fall, She is 
to fill out a form for each child in her class according to the procedure 
given on the instruction sheet. This includes the children from the Fall 
who are still in her class and any new children who have entered her class. 
The teacher does not fill out CPSC's for children who have left her class 
prior to April 1, 1971. If any one other than the teacher fills out one 
or more CPSC's her name and title must be entered in the space "Rated by". 
However, please make every effort to get CPSC's done by the teacher. 

4. Packing ^Trunks for Return to SRI ; 

a. If, when you are packing the completed test materials for return to SRI 
you find you cannot put everything back into the trunks, then you may 
discard the blank pads of paper and the pictures of the telephone poles. 
Use the packing material (foam) as shown in the packing diagram to prevent 
damage to the trunks. Put the trunk keys in the Site Coordinator Kit. 

b. When you pack to return your materials, please do not mix up forms from 
one class with another. 

5. Testing Supervision : 

It is most important that you carefully check the testing procedures during 
the first two days so that you can correct any errors in administration and 
improve the testing environment if necessary. Try to sit in with each of 
your Auxiliary Battery Testers while sh|e is testing. Tell your testers at 
the training sessions to expect you. to sit in with them at least once during 
their testing for quality control. 

G-10 
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GENERAL INSTRUCTZi»fS - AUXILIARY BATTERY TESTERS 



All the materials that you receive in your Testing Kit must be returned 
regardless of the condition, with the exception of the blank pads of paper 
and the Draw-a-Line sheets. These may be discarded if you cannot pack the 
other test forms compactly in your Kit, Also, please pack your Kit away after 
each day and place it in a safe place for the next day of testing. No one is 
allowed to see any of your completed tests except your Sit^ Coordinator. Do 
not give any BLANK test forms to anyone, either. 

Reminders for Administering Your Test Battery 
1^. Individual Test Booklets 

a. All information should be printed on the Test Booklets. 

b. Times started and finished must be noted as well as the date. 

c. Note on the test if a child has refused to be tested or was 
absent. If other difficulties arose to interfere with the 
testing, then an explanation must be entered in your tester's 
log. 

d. Children who cannot be tested because of absenteeism should 
be tested when they return to class if you are still at the 
center^ Otherwise return to the center for these children 
if there is time. 

e. Children's names should be spelled as they appear on each 
Class Print-Out. 



a. The two BLANK columns on the right hand side of the Form are 
for our use, please do NOT write in them. The column on the 
far left hand side of the Form is also for office use only. 

,b. Please print all entries made on this Form. 

c. Please do not mix classes on this Form (but use 2 sheets per 
class if necessary). Also, testers should use separate sheets 
even. if one class necessitates two testers. This procedure 
will assist us in keeping track of which testers tested which 
children. 

d. . All children who are tested are to be listed. Those children 

who are to be tested are listed on the Print-Out of Classes. 
Your Site Coordinator will instruct you on how to use this 
Form. List all children on the Record of Children Tested. 
If you don^ t test them, give the reason they were not tested 
(absent, refused, new, child). 



2. 



Record of Children Tested (yellow) 



2. Recorci or Chi 1 (Iron Tom tod (Contlnuod) 



e. Be sure to write the language in which you test each child 
in the first column after their name. 

f . Please be sure to check o/i under the appropriate heading 
•when a test has been completed for a child. 



Please be sure to check with your Site Coordinator about all instructions we 
have given you. Your Site Coordinator will be able to instruct you further 
concerning the administration of your test battery. 

Remember^ your Site Coordinator has been instructed on all parts of the test 
battery to assist you if any questions arise that your general instructions do not 
answer • 
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CHECKLIST FOR BINET TESTERS 



Q Read the Hertzlg^Blrch Scoring Manual (there are some changes from the Fall). 

For each test: 

Q Adralnlstor and score the test (using Hertzlg-Blrch coding) • 

□ 
□ 

Q Complete front page of Supplementary Worksheet. 

a 

Q Note unusual conditions, procedures , or outcomes in the Tester*s Log. 

Q Place lif Form Inside the Supplementary Worksheet* 



Be sure to Indicate whether a test was passed with 4- or - In the 
'pass-fail^ column of the Supplementary Worksheet. 

Be sure codes are entered in the Supplementary Worksheets for all Year- 
Level tests administered (including Basal and Celling Years). 



Fill In Name, Examiner, Date of Test, School. Test Summary , and Factors 
Affecting Test Performance on the Uil Form. 
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RECORD OF TEST DATA AND INFORMATION 
FORMS TRANSMITTED TO HURON INSTITUTE 
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Appendix H 



RECORD OF TEST DATA AND INFORMATION 
FORMS TRANSMITTED TO HURON INSTITUTE 



The following data were sent to Huron Institute on the dates 
listed: 



Date Sent 



(1) Data tapes sent to Huron 

• 1969-*70 data tape (complete and 
including tape description) 

• 1970*-71 (including tape descriptions) 

- Fall 

-* Spring (Pupil test scores and 
demographic tape) 

- TIF, PIF, AIF 

- Class observation tape 

• 1971--1972 (complete except for the 
class observation data tape to be 
analyzed by SRI) 



June 8» 1971 

June 8) 1971 

October 10, 1971 
October 1971 
November 1971 



September 18, 1971 



(2) Additional data from 1971-*72 sent to Huron 
« 

• HS Directors Ratings of Teachers 

• Sponsors Ratings of Teachers 



• HSD Evaluation of Model and 
Implementation Report 

• SRI Field Supervisors Report 

• Detailed summaries of Site 
Coordinators logs 

• Detailed Summaries of Testers logs 

• Record of Tests administered. 
Fall 1972 

• Specification of Tests to be 
administered. Spring 1972 



August 3, 1972 
August 3, 1972 

t 

August 3, 1972 
September 28, 1972 

September 28, 1972 
September 28, 1972 

September 28, 1972 

September 28, 1972 
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• Code' Book (Detailed test coding 
instructions and procedures 
(Fall and Spring)) 

• Pupil Transfer Records 
• • Tape Descriptions (Fall and Spring) 

• Biographical data on Field Staff 

• Copies of p,10 of PIF and p. 5 of 
TIF' for coding by Huron 

Copies of test batteries for the six 
test periods sent to: 

• CCD 

• Huron Institute 

• Eric Clearing House (2 copies, 
including all materials such as trucks, 
crayons, wall boards, stimulus item 



September 28, 1972 

September 28, 1972 

September 28'^ 1972 

September 28, 1972 

September 28, 1972 



September 28, 1972 
September 28, 1972 



booklets, etc.) 

The final HS data bank tape copies are 
retained in the SRI vault: 



September 28, 1972 



B5700 Tape 



Number Tape Label Contents 



#295 HSFINI/PSR1407 *A11 data. Fall 1969-Spring 1970 

#219 HSCOPY/PSR1407 Copy of tape #295 

#240 HSFL70/PSR1407 ♦All data. Fall 1970 

#281 T08655/PSR1407 Copy of tape #240 

#395 HSTEST/PSR1407 *A11 data, Spring 1971, except 

parent, teacher, and aide in- 
terviews 

#418 HSTC0P/PSR1407 Copy of tape #395 

#110 HSSP72/PSR1407 Spring 1971 parent, teacher, 

and aide interviews 
#504 HSS71C/PSR1407 Copy of tape #110 

#513 HSFL71/PSR1407 *A11 data. Fall 1971 

#301 TO3732/PSR1407 Copy of tape #301 

#320 HSSP72/PSR1407 *A11 data, Spring 1972 

#455 T05864/PSR1407 Copy of tape #301 



Tapes do not include classroom observation data. 
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All the tapes were written on the B5500 with the following specifications 

7 channel tape 
556 BPI 
Odd Parity 

80 characters per record (card image) 
100 records per block. 




Appendix I 

QUIZZES AND ANSWER SHEETS FOR SPRING 1972 
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Appendix I 

QUIZZES AND ANSWER SHEETS FOR SPRING 1972 
CONTENTS 



Battery 
Basic Battery A 

Basic Battery B 



Supplemental Battery 



Test 

WRAT 

Gumpgookies 

PPVT 

PS I 

Enumeration 

Relevant Redundant Cues 
(Zings and Poggles) 

Motor Inhibition 

ITPA 

Brown Self Concept 
8-Block Sort - Observer 
8-Block Sort - Trainer 
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1-7 

1-9 

1-26 

1-28 

1-30 

1-32 
1-35 
1-39 
1-41 
1-43 
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HEAD START PLANNED VARIATION EVALUATION, Spring *72 



Tester Quiz: WRAT 
Instructions: Circle "T" if the statement is true or "f" if it is false 
General 

1. The time limits for the 8 section<> of the test are the same and 
must be started after giving the child the instruction. 

2. If the child does not respond, or does not hear you, ycu may 
repeat the entire instruction twice . 

Copying Marks 

3. If the child does not respond in one minute in the Copying Marks 
test, go on to the next test. 

Name Spelling 

4. In Name Spelling, if the child stops before finishing his name 
within one minute, you should encourage him by saying: GO AHEAD 
AND FINISH IT. 

5. The time limit for the child to recognize each of the first two 
letters of his name is 15 seconds. 

Recognizing and Naming Letters 

6. If the child gets three letters wrong in a row, you should go 
on to Part II, Naming 13 Letters. 

7. A correct answer gets a score of 1, a wrong answer gets a score 
of 2 and a sero is used for no response, "l don't know," or 
responding with a number. 

Spelling 

8. The time limit is 15 seconds per word after you have given the 
complete sentence for each word; however, if the child takes 
more than 15 seconds to write the word, you indicate this fact 
by checking the appropriate box. 

9. If the child requests it, you may repeat the sentence which 
contains the word. 

10. If the child misses 3 in a row, go on to the next section. 
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Dot Counting 

11. The tinie limit for the child to count the dots is fifteen 
seconds • 

12 • The child must count and point to each dot in a row, i.e., 
he may not skip any dots in pointing. 

13. You are to circle the last dot correctly counted and 
pointed to. 

Reading Numbers and Arithmetic 

14. If the number 17 is read as 1 and 7 by the child , it is scored 
correct • 

15. The time limit is one minute for Part 1, Reading: Numbers, and 

1 minute for each of the questions asked in Part 2, Arithmetic. 

16. You record the child's exact answer for all the arithmetic 
questions. 

Arithmetic (Written Computation) 

17. If the c hild doe& notwrlte the answer "2" to the first problem 
(1 + 1 = I I discontinue this section and go on to the next 
test. 

18. The time limit for each of the four arithmetic problems is 30 
seconds. 

Word Reading 

19. This is a test of the child's ability to recognize words, not 
of pronunciation. 

20. If the child misses the 2nd, 3rd and 4th words » you stop the 
test . 

21. If the child changes his correct answer to an incorrect answer, 
you should score the word as wrong. 

22. For the first two words, you should ask the child to say the 
word again if he makes an error. 
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Answers to Tester Quiz; WRAT 



1. 
2. 

5. 



6. 



False* 

False. 

True. 
True. 
False. 



False. 



The time limits are not the same for all sections* However, 
all timing starts after the instructions are given to the child. 

You may repeat the entire instruction once if the child does 
not respond or does not hear you. 



The time limit is .10 seconds per letter. Remember , you are to 
use the first two recognizable letters » not necessarily the 
first two. If the child makes no response, entti NR in the 
space allowed for each letter. 

You discontinue Part I, Recognizing 10 Letters, if the child 
has scored 3 zeros in a row; i.e., made no response) » said I 
don*t know** or answered with a number. 



7. True. 

8. True. 

9. False. 

10. True. 



You may repeat only the wrd, if tho child requests it or you 
feel it is necessary (then start timing again). 

Remember ~that missing a word means it was misspelled 

(letters reversed, added , omitted or substituted) or not written 

at all. 



11. False. 

12. True. 

13. True. 



14. False. 



15. False. 



16. False* 



The time limit is one minute. 



You must also record the last number the child says aloud » even 
if it is the same as the dot you circled. Also, remember that 
the child is to tell how many dots there are and you record this, 
but some children may not remember this instruction, iii which 
case you enter NR next to the line "How many dots there are." 



The correct answer is seventeen, not 
seven, r 



II ft 
one seven 



or one and 



In Part 2, note carefully that the first two questions together 
are to be done in 1 minute as are the 3rd and 4th questions. 
Each of the last three questions cias a 1 minute limit. 

The first two questions (SHOW ME THREE FINGERS and NOW SHOW ME 
EIGHT FINGERS) are only scored. For the remaining questions, 
enter the child's response and enter the score. 



* On the score form, this reminder slipped down into Psart 2. 
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17. True. 



18. 



True. 



You discontinue this section if the child fails to write the 
nvmber "2." may be able to answer verbally and yet be 
unable or unwilling to write it down. If he writes a "2", go 
on with examples B, C ard D. 



Go on to the next problem even if the child has not finished 
in the 30 seconds. 



19. 
20. 



True. 
False. 



Make alla.^ances for accents and speech defects. 

Th;^ child must be presented the first 4 words. If he misses 
3 in a row after the first four words, discontinue the test. 



21. 
22. 



True. 
False. 



You score his last response. 

Only on the first word do you ask him again, if he is wrong. 
Do not ask the child to repeat any other wrong answers unless 
you could not understand him, in which case it would be 
necessary to ask him to repeat the word. 



n 
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HEAD START PLANNED VARIATION EVALUATION, Spring '72 
^ Tester Quiz: GUMPOOOKIES 
Instructions: Circle "t" if the statement is true and V* if it's false. 



1. On the Practice Items as well as the 27 Test Items, always point 
to the left-hand Gumpgookie or the top Gumpgookie, depending on 
the format of the page. 

2. If the child is a girl, skip page iv of the introduction and read 
page V, then go on to the first Practice Item. If the child is a 
boy, read page iv but skip page v and go on to the first Practice 
Item. 

3. On the Practice Items, if the child chooses the same Gumpgookies 
for both Sections 1 and 2, you still ask Section 3. 

4. During the Test Items, you may periodically remind the child that 
his Gumpgookie is the one which does what he does,, likes what he 
likes. 

5. If the child appears not to understand an item* you may reword an 
item for him as long as you do not change the meaning and intent 
of the item. 

6. The child should be encouraged to give an answer. The item may be 
repeated once as it is printed if the child does not answer after 
5 seconds. 

7. If the child misses Practice Item(s) on page(s) viii and/or ix, 
repeat the four Practice Items and score in the appropriate place 
on the score form. 

8. The key words on the score form are for the tester's convenience 
only — they should not be emphasized In the reading of the items. 
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Circle one 



1. False. 

2. True. 

3. False. 

4. False. 

5. False. 

6. True. 

7. True. 

8. True. 



Answers to Tester Quiz; GUMPGOOKIES 



Point to the Gumpgookie indicated in parentheses on 
the left of the description first, then to the other 
Gumpgookie. 



Only if his choices are not consistent. 

Remind the child only on the Practice Items if he does 
not choose the same Gumpgookie. 

Read the item exactly as printed. 

You may repeat the item once in the Practice Items 
and once during the Test. 



However, the items should be read with expression, but 
not in a way that would influence the child's choice. 
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HEAD START PLANNED VARIATION EVALUATION. Spring *72 



Tester Quiz; PEABODY 



Instructions: Circle '*T** if the statement is true or **F*' if it is false. 



I. If the child cannot understand the word you are sayinp, it is all 
right to use it in a sentence. 



2. It is important to use the same phrase PUT YOUR FINGER ON 

before saying each word. 

3. If a child gets 2 correct, misses 1, gets 2, correct, misses 4, 
gets 1 corrGc! > and misses 1, you should discontinue the test. 

4. If a child points to the line between the pictures you should give 
him the benefit of the doubt and count it correct. 

5. It is all right to encourage the child to point to one of the 
pictures. 

6. If a child only looks at one comer of the page discontinue the test. 

7. The time started and time finished are important in the analysis of 
the data, so you should always have a watch or clock available in 
order to record these times. 

8. If a child asks you if he answered correctly, you should always tell 
him that he was right or wrong. 

9. If the child has not learned to follow the test directions (pointing 
to the correct picture) after going through three trials, the test 
should be stopped. 

10. If the child misses Question 26 you should go back to Question 1 
and continue until he has six correct responses in a row, 

llm SRI researchers never make mistakes* 



T F 

T F 

T F 

T F 

T F 

T F 

T F 

T F 

T F 

T F 
T F 



V 
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1. False. 

2. False. 

3. False. 

4. False. 

5. True. 

6. False. 

7. True. 

8. False. 

9. False. 

10. False. 

11. False. 



Answers to Tester Quiz: PptABODY 



You may pronounce the word more than once, but do not use it 
in a sentence, explain what it means, make it plural, or use 
"a" or "an" or "the'' in front of the word. 

So the child does not get bored, vary the introduction by 
saying "show me" or "Polnt to" or "Find" or "where is." 

If he misses the next one, you would discontinue the test. 
However, at this point he has missed only 5 out of 8. 

If you don't know for sure which picture he is pointing to, 
ask him which one he is pointing to. 

It is O K. for the child to guess, and he should be encouraged 
to continue pointing to the one he thinks is correct. 

You should remind him to look carefully at all four pictures 
and if he still looks at only one corner, you should point to 
each picture and remind him to look at each one. 

The length of time che test takes, the time o-T day the test 
was administered, and the date, are all important variables 
and are entered into the data bank. 

You should simply tell him "That was a good answer," without 
telling him it was right or wrong. 

You discontinue after four trials. 

You begin at question 25 and if the child misses one 
question before you get to question 32 (8 questions) go 
backwards beginning at question 24 until he has 8 correct 
in a row. You now go back to the question after the one 
he first missed and continue testing until he misses six 
out of 8 in a row. 

Please go through all of your score forms and make the 
following correction: Item 48, tumble, should be (2) 
instead of ( 1) . 
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Head Start Planned Variation Evaluation, Spring '72 

Tester Quiz: PEABODY Scorinp: 

Instructions: In the five scoring examples shown b low, assume the first ten 
items were correct and indicate if a test: 

a. Was stopped at the correct point, or 

b. Should have been continued, or 
, c. Went too far. 



Example: 



3) 



(4) 


O 


(1) 




131 




(11 


0 


(2) 


O 


(3)" 


□ 


«4) 




(?) 





2. 



(1) ( ^ 

(il-J—a' 

(4) 



_□ 

(3) ^ 

(II 

(?) 0 

en O 

(4) □ 

(3) A 



(3) 

(4) 

(2) 

(4) 

(2) 

(II. 

(?l 

(41 



3. 



(II 



L l"3 

(21 / 

(2) _:l. 

(4l_f£ 

(1) / 0 

(3) L. '7> 

(21_3_W 
(31 ^JL /. 



(4) 

(2) 2> C 

(ii__z^ 

(3i_L.>?r 

(2l_i_ jZT 

<1l_i_ □ 

(11^ 

<3i_^;^ 

(4) / ;^ 

(4) 0 

(1) o 

(1) □ 



4. 



i3) 
2) 
4) 
1) 



2, 0 

3_ ■ 



3) 



21 



4)_jL t^r 
II 2 ^ 

3I_J_ o 

2)_i_ ja- 

4) 

2) 2- 

ii_2i.;^' 

31 _L.^ 

2) O 

II □ 

II /.. 



s. 



CI 

(?) 



(1) 

(3) 3 

(3) 

(11 

(?) 3 
(•1) 
<1) 



7. 



0 

C) 

/ 

( U 

(U 7- a 

<31 L'1 

(41 / y. 

(2) / 

(21 <r 

(41 ^ 



a. 



□ 

c. □ 



c. P 



b. □ 

c. □ 



a. 



□ 
- □ 



>• □ 

□ 



c. 



Example 6 



In the example given below, what is the number of the next item to be- 
administered? 



BEGIN TEST HERE 



1 

1 


car 


(4) 




I 


cow 


lot 


1 — 1 
LI 


o 

J 




Ml 


/■. 


A 

4 




(2) 




c 
D 


Kill 




C9 




block 






7 


clown 


(2) 


A 

V 


8 


key 


(1) 


o 


9 


can 


(4) 


□ 


10 


chicken 


(2) 




11 


blowing 


(4) 




12 


fan 


(2) 




13 


digging 


(1) 




14 


skirt 


(1) 


0 


15 


catching 


(4) 


o 


16 


drum 


(1) 


□ 


17 


ICuf 


(3) 




18 


tying 


(4) 


o 


19 


fence 


(1) 




20 


bat 


(2) 




21 


bee 


(4) 


0 


22 


bush 


(3) 


o 


23 


pouring 


(1) 


□ 


24 


sewing 


111 


A 



25 



wiener 



26 teacher 

27 building 

28 arrow 

29 kangaroo 

30 accident 

31 nest 

32 caboose 

33 envelope 
(on'-ve-lop) 
(812) 

34 picking 

35 badge 

36 goggles 

37 peacock 

38 queen 

39 coach 

40 whip 

41 net 

42 freckle 

43 eagle 

44 twist 

45 shining 

46 dial 

47 ynwning 

48 tumble 
19 signal 
GO capsule 



(4) 






(2). 




(3) . 


3 




(3) 


3 


0 


(2). 


2- 


o 


13) 


3 


□ 


(3) . 




A 


(4). 


jL 


O 


(11 . 






n'-ve-lop) 


(2) . 






(1). 




0 


(3) 




o 


(2) . 




□ 


(3) . 




A 


(4) 




O 


(1) 






(4) 






(4) 




0 


(3) 




O 


(2) 




□ 


14) 






(2) 






(2) 






(1) 






(1) 




0 


ID 




o 



51 

52 

53 

54 

55 

56 

57 

58 

59 

GO 

61 

62 

63 

64 

G5 

66 

67 

68 

69 

70 

71 

77 

73 

74 



submnrine 

thermos 

fjrojcctor 

group 

tiickling 

transportation 

counter 

cn^cmony 

pod 

bronco 

directing 

funnel 

dpliqht 

lecturer 

communication 

archer 

stadium 

rxcavdte 

asMiilting 

stunt 

mrringiie 

appliance 

chemist 



14) □ 

14) A 

13) O 

_0 



14) 
13) 
ID 



arrtic 

(ark-tik) {art 



ID O 

12) □ 

13) A 

14) O 

13) 

(4» "s^r 

12) 0 

13) O 

(2) □ 

(4) A 

ID O. 

ID Z> 

14) ^ 

ID 0 

ID O 

13) n 

14) A 

13) O 



-ik) 



75 destruction 



14), 
r 
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Example 7 



In the example given below, what is the number of the next item to be 
administered? 



BEGIN TEST HERE 



25 



wiener 



(4) 



1 


car 


(4) 




o 


26 


tenchcr 


(2) 


2 


cow 


(3) 




□ 


27 


building 


(3) 


3 


baby 


(1) 






28 


arrow 


(3) 0 


4 


girl 


(2) 




o 


29 


kangaroo 


(21 O 


5 


ball 


(11 






30 


accident 


(3) □ 


6 


block 


(3) 






31 


nest 


(31 A 


7 


clown 


(2) 




0 


32 


caboose 


(41 O 


8 


key 


(1) 




o 


33 


envelope 


(11 C? 


9 


can 


(4) 




□ 




■ fin * • ^ 1 1 

\en -VC-lopi 

(812) 


(sn'-ve-lop) 


10 


chicken 


(2) 






34 


picking 


(2) ^ 


11 


blowing 


(4) 




o 


35 


badge 


(1) 0 


12 


fan 


(2) 






36 


goggles 


(3) O 


13 


digging 


(1) 






37 


peacock 


(2) □ 


14 


skirt 


(1) 




0 


38 


queen 


(3) A 


15 


catching 


(4) 


JLo 


39 


coach 


(41 O 


16 


drum 


(1) 


I 


□ 


40 


whip 


(1) V 


17 


leaf 


(3) 


3 


A 


41 


net 


14) iJr 


18 


tying 


(4) 


a 


O 


42 


freckle 


(4) 0 


19 


fence 


f * t 

\ 1 1 






43 


eagle 


(3) O 


20 


bat 


(2) 


z 




44 


twist 


(2) □ 


21 


bee 


(4) 


1. 




45 


shining 


(4) A 


22 


bush 


(3) 


3 


o 


46 


dial 


(21 O 


23 


pouring 


(1) 


; 


□ 


47 


yawning 


(2) Q? 


24 


sewing 


(1) 


/ 


A 


48 


tumble 


(1) <T 












49 


signal 


(11 0 












60 


capsule 


(1) o 



51 submarine (4) d 

52 thermos (4) /.\ 

53 projector (3) O 

54 group (4) 

55 tarkli-.g {3) 

56 transportation Ml 

57 counter (1) O 

58 ceremony (2) Q 

59 pod (3) A 

60 bronco (4) O 

61 directing (3) 

62 funnel (4) ^ 

63 delight (2) 0 

64 lecturer (3) O 

65 communication (2) d 

66 archflr (4) A 

67 stadium ( 1 ) O 

68 excavate (H C9 

69 as'iaulting (4) ^ 

70 stunt (1) 0 

71 meringue (1) O 

72 appliance (3) □ 

73 chemist (4) A 

74 arctic (3) O 
(ark'-tik) (art'-lk) 

141 



75 destruction 



erJc 
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Example 8 



In the example given below, what is the number of the next item to be 
administered? 

BEGIN TEST HERE 



1 car 

2 cow 

3 baby 

4 girt 
ball 
block 
clown 



5 
6 
7 



8 key 

9 can 

10 chicken 

1 1 blowing 

12 fan 

13 digging 

14 skirt 

15 catching 

16 d'um 

17 leaf 

18 tying 

19 fence 

20 bat 

21 bee 

22 bush 

23 pouring^ 

24 sewing ^ 



14) O 

<3) □ 

(1) A 

(2) O 

(1) ^ 

(3) ^ 

(2) 0 

ni O 

(4) □ 

(2) A 

(4) O 

(2) ^ 

(1) <f 

(1) 0 

(4) O 

(1) □ 

<3) A 

(4) O 

(1) 

(2) ^ 

(4)_SL 0 

(3) .i O 

(i)_L □ 
(i)_L A 



25 wiener 



14) ^ o 



26 teacher 

27 building 

28 arrow 

29 kangaroo 

30 accident 

31 nest 

32 caboose 

33 envelope 
(en'-ve-lop) 
(812) 

34 picking 

35 badge 

36 goggles 

37 peacock 

38 queen 

39 coach 

40 whip 

41 net 

42 freckle 

43 eagle 

44 twist 

45 shining 

46 dial 

47 yawning 

48 tumble 

49 signal 
60 capnito 



(2)_2lC? 



(3) 
(3) 
(2) 
(3) 

(3) 

(4) 

(1) 

(an'-ve-lop) 



□ 

A 
O 



(2) 





(1) 


0 


(3) 


O 


(2) 


□ 


(3) 


A 


(4) 


O 


(1) 


V 


(4) 


^ 


<4) 


0 


(3) 


o 


(2) 


□ 


(4) 




(2) 




{2» 


^ 


(1) 


<r 


(1) 


0 


(1) 


O 



51 


submarine 


14) 


1 1 


52 


thermos 


(4) 






projector 






54 


group 


(4) 






tackling 


fit 




56 


trdnspprtation 


fit 

(li- 


_ V 


57 


i'.ounter 


nt 


<J 


58 


ceremony 


C2) 


□ 


59 


pod 


(3) 




60 


bronco 


(4)_ 




61 


directing 


(3)_ 




62 


funnel 


(4)__ 




63 


delight 


<2)_ 




64 


lecturer 


<3)«. 


— o 


65 


communication 


(2)_ 




66 


archer 


(4)«_ 


_A 


67 


stadium 


111 — 




68 


excavate 


n)_ 


— ^ 


69 


assaulting 


(4)_ 




70 


stunt 


n)_ 




71 


meringue 


0)_ 


— o 


72 


appliance 


(3)_ 




73 


chemist 


<4)_ 


_ A 


74 


arctic 


{3)_ 






(ark'-tik) Cart'-ik) 




lb 


dntnidiofi 


<4)_ 





mc 



1-14 

.3u7 



Example 9 



In the example given below, what is the number of the next item to be 
administered? 



BEGIN TEST HERE 



1 


car 


(4) 


o 


2 


cow 


(31 


□ 


3 


bJby 


(11 


L. 


4 


girl 


(2) 


O 


5 


ball 


(1) 




6 


block 


(31 




7 


clown 


(2) 


0 


8 


key 


(11 


O 


9 


can 


(41 


□ 


10 


chicken 


(2) 




11 


blowing 


(4) 


o 


12 


fan 


(2) 




13 


digging 






14 


skirt 


(11 


0 


IS 


catching 


(41 


o 


16 


drum 


(11 


□ 


17 


leaf 


(31 


A 


18 


tying 


(41 


o 


19 


fence 


(1) 




20 


hat 


(21 




21 


bee 


(4) 


0 


22 


bush 


(3) 


o 


23 


pouring 


(1) 


□ 


24 


sewing 


(1» 


A 





wiener 


(4) ^ 0 


26 


teacher 


(2)«3^C? 


27 


building 


(3)^TSr 


28 


arrow 


(3)^0 


29 


kangaroo 


(2)_*L.O 


30 


accident 


(3)^a 


31 


nest 


(3) JL/ 


32 


caboose 


(4) O 


33 


envelope 


(1) 




(en'-ve-lop) (an'-ve-lop) 




(812) 




34 


picking 


(2) ^ 


35 


badge 


(1) 0 


36 


goggles 


(3) O 


37 


peacock 


(2) □ 


38 


queen 


(3) A 


39 


coach 


(4) O 


40 


whip 


(1) C 


41 


net 


(4) ^ 


42 


freckle 


(4) 0 


43 


eagle 


(3) O 


44 


twist 


(2) □ 


45 


shining 


(4) \ 


46 


dial 


(2) O 


47 


yawning 


(2) 


48 


tumble 


(1) it 


49 


signal 


(1) 0 


GO 


camutt 


(1) O 



51 submarine 

52 thermos 

53 projector 

54 group 

55 tackling 
5G transportation 
5/ counter 

58 ceremony 

59 ocd 

60 bronco 

61 directing 

62 funnel 

63 delight 

64 lecturer 

65 communication 

66 archer 

67 studium 

68 excavate _ 

69 assaulting 

70 stunt 

71 meringue 

72 appliance 

73 chemist 

74 arrtic 
(ark'-tik) (art'-ik) 

75 dtitniction 



(4) 

(4) 

(3) 

(4) 

(3) 

(1). 

(1) 

(2) 

(3) 

(4) 

(3) 

(4) 

(2) 

(3) 

(2) 

(4) 

(1) 

(1) 

(4) 

(1) 

(1) 

(3) 

(4) 

(3) 

(4) 



. /r» 
.o 
.\) 

.0 
.O 

.□ 

.0 

.o 
.□ 
.A 

.0 

,o 
.o 



Example 10 



Instructions: Here Is an example in which too many Items were presented to a child. 

a. Circle the lowest Item number that should have been given. 

b. Circle the last Item number that should have been given. 



1 car 

2 cow 

3 baby 

4 girl 

5 ball 

6 block 

7 clown 

8 key 

9 can 

10 chicken 

1 1 blowing 

12 fan 

13 digging 

14 skirt 

15 catching 

16 drum 

17 leaf 

18 tying 
fence 
hat 
bee 
bush 
pouring 



19 

20 
21 
22 
23 



24 sewing 



14) V O 
(3»_3. □ 
(1J_J- A 
(21 O 

(3) _^tlr 

(2)_^ 0 

(i»_^ o 

(4) _3L □ 

(2) ^ /. 
(4) _± O 

(2) _^ 

0 

(4)_i^O 

(3) A 

(4) _^ 0 
«3)^ O 

(1) /_ A 





BEGIN TEST HERE 














?r. 


tearher 


(2)_2-.C 


27 


building 


(3)^-51? 


28 


arrow 


(3)_J_ 0 


29 


kangaroo 


(2)_L.O 


30 


accident 


(3) n 


31 


nest 


(3)_2_A 


32 


caboose 




33 


cnvL'lope 





(en'-ve-lop) (an'-ve-l6p| 
1812) 



34 picking 

35 uddge 

36 'jtjggles 
3/ peacock 

38 queen 

39 coach 

40 whip 

41 net 

42 freckle 

43 eagle 

44 twist 

45 shining 

46 cJial 

47 yawning 

48 tumble 

49 signal 
50- capiule 



13) 
(3) 

(4) *y 

(1) _^0 

(3) ^0 

(2) _Z_D 

(4) 3 _ /■ 

(2) jLo 

(2)^<P 

(i)^T?r 
0)^ 0 

H) JL o 



51 submarine 

52 thermos 

53 projector 

54 gi oup 

55 tackling 

56 transportation 

57 rountc^r 

58 corrmony 

59 pod 

60 bronco 

61 directing 

62 funnel 

63 delight 

64 lecturer 

65 communication 

66 archer 
stadium 

68 excavate 

69 assaulting 

70 stunt 

71 meringue 

72 appliance 

73 iJiemist 

74 jrctic 
(urk'-tik) (art* 

75 destruction 



-4) ^ □ 

(4)_4^/. 

(3) _2_ o 

(4) _iLc? 

(3) _3_^ 
(i)_2:-0 

(1) _^0 

I3> V /• 

(4) ^ O 

131 2. C9 

(4) _Z ^ 

(21^0 

(3) _1_0 

(2) ^a 

(4) __L_iCi 

(i)_Z^O 
(i)-^0 

»3).^a 

(4) /- 

(3) J5Lo 



-iki 



(41 



Example 11 



Instructions: Here is an example in which too many items were presented to a child, 

a. Circle the lowest item number that should have been given. 

b. Circle the last item number that should have been given. 



BEGIN TEST HERE 



1 


car 


(4)_j/ O 


2(3 


tUijLhcr 


2 


cow 




27 


building 


3 


baby 


(i»-jL a 


28 


arrow 


4 


girl 


<2»^ O 


29 


kangaroo 


5 


ball 


^^)^ ^ 


30 


accident 


6 


block 


(3»^ ^ 


31 


nest 


7 


clown 


i2) 2, 0 


32 


caboose 


8 


key 


o 


33 


envelope 


9 


can 






(cn'-ve-lop) 


10 


chicken 


(2) ^ A 


34 


picking 


11 


blowing 


(4) ^ O 


35 


badge 


12 


fan 


(2» JL 


36 


goggles 


13 


digging 




37 


peacock 


14 


skirt 


0 


38 


queen 


15 


catching 




39 


coach 


16 


drum 


n» JL« □ 


40 


whip 


17 


leaf 




41 


net 


18 


tying 


<4»^0 


42 


freckle 


19 


fence 


(1) J_ 


43 


eagle 


20 


bat 


(2) 


44 


twist 


21 


bee 


(4)^ 0 


45 


shining 


22 


bush 


(3)_2- O 


46 


dial 


23 


pouring 


n)_2L □ 


47 


yawning 


24 


sewing 


<n J^ A 


48 


tumble 








49 


signal 








50 


capiule 



2G 



WIXIKT 



(a 



3) 3 ^ 
2)^0 
^1 3 A 



4) _aL o 

'-ve-l6p) 



0 

o 
□ 

A 

O 



3) _Z_ 
4) 
1) 

A) V 0 
3)_^0 
2) 3 □ 

41 _2_ /I 
2)_Z_C? 



51 submarine 

52 thermos 

53 projector 

54 group 

55 tarkling 

56 transportation 

57 counter 

58 corcmony 

59 pod 

60 bronco 

61 directing 

62 funnel 

63 delight 

64 lecturer 

65 communication 

66 archer 

67 stadium 

68 excavate 

69 assaulting 

70 stunt 

71 meringue 

72 appliance 

73 chemist 

74 arctic 
Uk'-tik) (art'-ik) 



/ n 

(3) 

(1)^0 

(1) _L.o 

(2) _iLD 

(3) _^i./. 

(4) ;> 

(4)^V^ 

^0 



(2) _ 

(2)«i.n 

3 A 

li)«Z_0 
ii)_SLC? 
<4) 3 -iir 



(1 



3)_Z-.0 



76 (Jestriintinn 



(4) 



Example 12 



Instructions: Here is an example in which too many items were presented to a child, 

a. Circle the lowest item number that should have been given. 

b. Circle the last item number that should have been given. 



BEGIN TEST HERE 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 



car 
cow 
bat// 
girl 
ball 
block 
clown 
key 
can 

chicken 
blowing 

12 fan 

13 digging 

14 skirt 

1 5 cdtching 

16 drum 

17 leaf ^ 

18 tying 

1 9 fence 

20 bat 

21 bee 

22 bush 

23 p*: ring 

24 sewing 



o 

(3)_J_ □ 

(3)_3_ 
(2i__L 0 

(4I_jL □ 
(2)_*1_ A 
(41 V O 



"0 
0 

o 
□ 

o 

(1) / C9 
12) ^ lir 

0 

(3).3_ o 

n) ^ A 



(11-^ 
mj 

(4) 
(1) 
(3) 
(4) 



25 


wii;ner 


(4) 






2G 


tejchcr 


(2) 


2. 




27 


building 


(3) 


2. 




28 


arrow 


(3) 


2. 


0 


29 


kangaroo 


(2) 


f 


O 


30 


accident 


(3) 


3 


□ 


31 


nest 


(3) 


jL 


A 


32 


caboose 


(4) 


\ 


O 


33 


envelope 


(1) 


2- 





(cn'-vc-lop) 
(812) 

34 picking 

35 badge 

36 (joggles 

37 pe3Co:k 

38 queen 

39 coach 

40 whip 

41 net 

42 freckle 

43 eagle 

44 twist 

45 shining 

46 dial 

47 yawning 

48 tumble 

49 signal 

50 capsule 



(an'-ve-l6p) 
<2)_JL^ 

(3) ^ O 
<2)^ □ 

\2\JL^ A 

(4) O 

(1) _L. 

(4) jLiir 
(4)_L 0 

(3)^ O 

(2) Ji. O 
(2) J_Q? 

ni^ 0 

(II jaL O 



51 submarine 

52 thermos 

53 projector 

54 group 

55 tjckling 

56 transportation 

57 countpf 

58 ceremony 

59 pod 

60 bronco 

61 directing 

62 funnel 

63 delight 

64 lecturer 

65 communication 
G6 archer 

67 stadium 

68 excavate 

69 assaulting 

70 stunt 

71 meringue 

72 appliance 

73 clu?mist 

74 arctic 
(ark'-tik) (art'- 

75 destruction 



(4) n 

(3) / O 

(ii_Z_o 

(?) 3 □ 

(3) 3 . 

13) JL.^ 

(2)J^0 

t3i 2- n 

(2i^n 

(4) jrf_/. 

(i)_Z_o 

(4) JL_'5ir 
(1)^0 

(i)_^0 



(3) 



_□ 

(4) J_A 

(31 J^O 



ik) 



(41 



erJc 



1-18 



3U 



Example 13 



Instructions: Here is an example in which too many items were presented to a cUil^i. 

a. Circle the lowest item number that should have been K^ven, 

b. Circle the last item number that should have been glvtn. 



BEGIN TEST HERE 









25 




<-»)_^.;, 


1 


car 


wlJL. O 


2G 


tLMt.lier 


(2) *^ ^ 


2 


cow 


n 




bu ildiit() 


(3J 3 ^ 


3 


baby 


t A 

(11 —L. 


28 


arrow 


(3) \/ 


4 


girl 


P> 2- (p 


29 


kangaroo 


2_ 

(2) ^ 


5 


ball 


Ml / CI 

(11—1— v 


JU 


accident 


(i» 3 n 


6 


block 




31 


nest 


/-^^ 3 / 


7 


clown 


(2i ^ V 


32 


caboose 




8 


key 


(1) f . v<J 






Ml 


9 


can 


lilt n 
(4)J2— U 




(nn'-we-l5p) 
(812) 


(sn'-ve-lop) 


1U 


chicken 




OH 






1 1 


blowing 


^ Cy 


JD 


1 InD 


Ml / 0 


12 


fan 


i CO 


JU 


goyyitis 




13 


digging 


(1) L- w 


37 


peacock 


111 I- r~i 

(2) U 


14 


skirt 


n)J_ 0 


38 


queen 


(3) -3 A 


15 


catching 


(4)_f/_0 


39 


coach 


(4) O 


16 


drum 




40 


whip 


(i)__L^ 


17 


leaf 




41 


net 




18 


tying 


i4)_iLc> 


42 


freckle 


(a)JL 0 


19 


fence 


n) JL 


43 


eagle 


(3)«3_ O 


20 


bat 


(2) 2- ^ 


44 


twist 


(2)_2^ □ 


21 


bee 


i4»_y_ 0 


45 


shining 




22 


bush 


13) _i o 


46 


dial 


(2) 2. o 


23 


pouring 




47 


yawning 


(2)_i_C? 


24 


sewing 




48 


tumble 


(D-L.-?^ 








49 


. signal 


(1)_L 0 








50 


capsule 


{1)_Z-0 



51 subm«irine 

52 thermos 

53 projector 

54 group 

55 tackling 

66 transportation 

57 counter 

58 ceremony 

59 pod 

60 bronco 

61 directing 
G2 funnel 

63 delight 

64 lecturer 

65 communication 

66 archer 

67 stadium 

68 excavate 

69 assaulting 

70 stunt . 

71 meringue 

72 appliance 

73 chemist 

74 arctic 
(jik'-tik) (art' 

75 destruction 



(4)_Z_a 

(3) _r3_<> 

(4) _2^C? 

(i)J3_0 

(1) _L_0 

(2) _i_n 

(3) V 
(3)_3_^ 

Ml ^ ^ 

(2). 
(3) 



0 

O 



(2) 



-ik) 



(4)_- 

(i)_2_ 

(1)_2^^ 

(i)-2_- 0 

(D-jL-O 

(3) __/_a 

(4) 2- A 
ni y O 



(4) 



1-19 

312 



Example 14 

Instructions: Here is an example in which too many items were presented to a child. 



a. Circle the lowest item number that should have been given. 

b. Circle the last item number that should have been given. 



BEGIN TEST HERE 



2b 



14) 



1 
2 
3 
4 
5 



car 
cow 
baby 
girl 
bdtl 

6 block 

7 clown 

8 key 

9 can 

10 chicken 

1 1 blowing 

12 fan 

13 digging 

14 skirt 

15 catching 

16 drum 

17 leaf 

18 tying 

19 fence 

20 bat 

21 bee 

22 bush 

23 pouring 

24 sewing 



(4) V O 
(3)_3_ □ 

(2) ^2^ O 

(1) _f_ ^ 

(3) ^iir 

(2) _Z^ 0 

o 

(4) _a:: □ 
(4)^ O 

(2) ^ 

n)J_ 0 

(4)j£.0 

□ 

(3) A 
l4)_fL0 

m / O 

(2) 2^ <i 

iA)JL 0 

(3) _^ O 



7C) tUiidicr 

27 building 

28 afrow 

29 kdngaroo 

30 »»Lriilent 

31 nest 

32 tjboose 

33 envelope 
{nn'-ve-lop) 
(812) 

34 picking 

35 badge 

36 goggles 

37 pcdcock 

38 queen 

39 coach 

40 whip 

41 net 

42 freckle 

43 eagle 

44 twist 
41) shining 

46 dial 

47 yawning 

48 tumble 

49 signal 

50 capsule 



^ C 
(31 ^ 
(31^0 
12) 

(3) ^a 
.3)JL/:. 

(4) jL o 

(1) J^c? 

(an'-ve-l6p) 

(2) J_'5ir 

(3) .J^ O 

(2) _i_ □ 

(3) _JL 



(4) 



(i)_iZ.C? 

(4)_i 0 

(3) __L.O 

(4) _i_ /. 

(21 _A_ O 



(2)_2.C? 
(1) 

(1) J_ 0 



51 suhmnrine 

52 thermos 

53 projector 

54 group 

55 tockling 

56 tronsportation 

57 counier 

58 coremony 

59 pod 

60 bronco 
01 directir>g 

62 funnel 

63 delight 

64 lecturer 

65 communication 

66 archer 

67 stadium 

68 excavate 

69 assaulting 
/O stunt 

71 meringue 

72 appliance 

73 chemist 

74 arctic 
(«irk'-rik) (art'- 

75 destruction 



□ 



(4) _ 
(4) _/ .' . 

(3) 3 o 

(4) J2^C> 

(3i_2_'5Jr 

(1) -2_0 
(dJJLo 

(21 2- □ 

(3) _iL/. 

(4) Z> O 

(3) J_C? 

(2) _2.0 

(3) _2_0 

(21 _i_a 

(4) , V 
(1)_2:.0 

(4)^iJir 
(i)-^0 



iki 



(3) 
(4) 
(31 

(41 



□ 

A. 



ERIC 



1-20 



313 



Example 15 



Instructions: Here Is an example In which too many Items were presented to a child. 

a. Circle the lowest Item number that should have been given, 

b. Circle the last Item number that should have been given. 



BEGIN TEST HERE 



Ciir 
cow 
baby 
girl 
ball 
block 
clown 
8. key 
9 can 

10 chicken 

1 1 blowing 

12 fan 

13 digging 

14 skirt 

15 catching 

16 drum 

17 leaf 

18 tying 

19 fence 

20 bat 

21 bee 

22 bush 

23 pouring 

24 sewing 



\A)^ O 
(3)^ □ 

(1) / , 

(2) -J:. O 

(3) JL. lir. 

(2)_2^ 0 

(1) _L o 

(4) ^ □ 

(2) _5r /-> 

(4)_^^ O 
(2)^ ^ 

(1)^ 0 

(4)^ O 

(3) ^ A 

(4) ^ O 

(4)^ 0 
13)^ O 
(1)^ □ 
(1) 3^ 



(4) 



?G teacher 

27 building 

28 arrow 

29 kangaroo 

30 accident 

31 nest 

32 caboose 

33 envelope 
(en'-ve-lop) 
(812) 

34 picking 

35 badge 
3G goggles 

37 peacock 

38 queen 

39 coach 

40 whip 

41 net 

42 freckle 

43 eagle 

44 twist 

45 bhining 

46 dial 

47 yawning 

48 tumble 

49 signal 

50 capsule 



(31 2^i^ 

(3) _L.O 

(2) J_0 

(4) JC O 

(an'-ve-lop) 

(1)^0 
(3) .^O 

(3) ^ A 

(4) O 

(4) 2> ^ 
(4^ 2. 0 

(3) ^0 
(2) 1^ □ 

(4) A 
(2) Jti O 
(2) 

(1)^ 0 
(1)^ O 



51 submarine 

52 thermos 

53 projector 

54 group 

55 tackling 

56 transportation 

57 counter 

58 cnromony 
50 pod 

60 bronco 

01 directing 

62 funnni 

63 dttlight 

64 lecturer 

65 communication 
G6 archer 

67 stadium 

68 excavate 

69 assaulting 

70 Munt 

71 meringue 

72 appliance 

73 chemist 

74 arctic 
Uk'-lik) (art' 

75 destruction 



(3) O 
14) JL^ 



(1), 
(1) 



Z- 
2. 



2- 

2=. 

_/_ 
I 



0 

.O 
□ 



(2) . 

(3) . 

(4) . 

(3) . 

(4) . 
(2). 
(3) 
(2) 
(4) 
(1) 

(4)_i£_1^r 

_^ 
I 



(3) . 

(4) . 

(3), 



O 

0 

O 



o 
□ 



-ik) 



(4), 



1-21 



Example 16 



Instructions: Here is an example in which too many items were presented to a child. 

a. Circle the lowest item number that should have been given. 

b. . Circle the last item number that should have been given. 



1 cur 

2 cow 

3 baby 

4 girl 

5 ball 

6 block 

7 clown 

8 key 

9 can 

10 chicken 

11 blowing 

12 fan 

13 digging 

14 skirt 

15 catching 

16 drum 

17 leaf 

18 tying 
fence 
but 
bee 
bush 

23 pouring 

24 sewing 



19 
20 
21 
22 



wJL o 

(3)_3_ □ 
(1)»1- A 

(1)-^ ^ 

(3) _3_ ^ 

12) _L. 0. 

(1) _i_ o 

(4) _fL □ 
I2)_2l_ a 

wjL o 

(2) _-l_ 

(i)_jL 0 

(4)_i. O 
(4)_1_ 



O 

0 

O 

□ 



(1) _L 

(2) 

(4)_/. 
(3) 
(1) 





BEGIN TEST 


HERE 












wiener 


(4) 




2G 


lojcher 


W _ 




27 


buildinq 


CJ) _ 




28 


arrow 


(3)_ 




29 


kangaroo 


(2) _ 


X-0 


30 


accident 


(3) jsLa 


31 


nest 




32 


caboose 


(4) jSLo 


33 


envelope 


(1) jbL^ 




(cn'-ve-l6p) (an'-ve 


-lop) 




(8^2) 






34 


picking 


(2) . 


35 


badge 


(1). 




36 


goggles 


(3) , 


__L.o 


37 


peacock 


(2) 




38 


queen 


(3) 




39 


coach 


(41 _iL O 


AO 


whip 


(1) 




41 


net 


(4) 




42 


freckle 


(4) 




43 


eagle 


(3) 




44 


twist 


(2) 




45 


shining 


M) 




46 


dial 


(2) 




47 


yawning 


(2) 




48 


tumble 


(1) 




49 


signal 


(1) 




50 


capsule 


(1) 





51 submarine 

52 ihernios 

53 projector 

54 group 

55 tackling 

56 transportation 

57 counter 

58 ceremony 
69 pod 

CO bronco 

61 directing 

62 funnel 

63 dcl.ijht 

64 lecturer 

65 communication 

66 archer 

67 stadium 

68 excavate 
G9 assaulting 

70 stunt 

71 mecingue 

72 appliance 

73 chemist 

74 arctic 
(iick'-tik) (art' 

75 destruction 



|4»_^D 

(4)_iL,^-^ 

13) O 

|4)J/_C? 
t3> I ^ 

(i)_2-0 
(2;_^D 
I3)_3_A 

_0 



_Z_-0 



-ik) 



(4). 

13) . 

14) . 
12). 
13) 

(2)^D 

(4)_2=LA 

(1)_/_0 

(1)_I_C?" 

(4)_L_^ 

(i)_fL.O 

(i)_iLo 

(3) 

(4) _J. A 

(3)_J__0 



1-22 

315 



Example 17 



Instructions: Here is an example in which too many items were presented to a child. 

a. Circle the lowest item number that should have been given. 

b. Circle the last item number that should have been given. 



BEGIN TEST HERE 



1 

1 


car 


(4) V n 


2 


COW 


(3) 3 □ 


o 


Uduy 


i^\ 1 A 


A 
*l 


girl 




C 

D 


Ddll 




Pi 
u 




{^\ 3 ^ir 


7 


clown 




o 
o 


key 


(1) ' u 


Q 


can 


i4l _L_ LJ 


10 


chicken 


(2)_^ A 


11 


blowing 


(4) / O 


12 


fan 




13 


digging 




14 


skirt 


(i)_L 0 


15 


catching 


(41 JI^O 


16 


drum 




17 


leaf 




18 


tying 


(4)jZ-0 


19 


fence 


(1) 


20 


bat 


(2) J^iir 


21 


bee 


(4)_L- 0 


22 


bush 


(3)^ 0 


23 


pouring 




24 


sewing 


(1) jZ. a 



25 wiener (4) ^ O 



26 teacher 

27 building 

28 arrow 

29 kangaroo 

30 accident 

31 nest 

32 caboose 

33 envelope 
(en'-ve-lop) 
(812) 

34 picking 

35 badge 

36 goggles 

37 peacock 

38 queen 

39 coach 

40 whip 

41 net 

42 freckle 

43 eagle 

44 twist 

45 shining 

46 dial 

47 yawning 

48 tuHDble 

49 signal 

50 capsule 



(31^ 0 

(2i_L-.0 

(3)_L_a 

(3)-:Z_ A 
<4) 2- (fb 

(1) _^e? 

(an'-ve-lop) 

(2) J_iir 

(1) -i-0 

(3) _L- O 

(21 □ 

(3) 3 A 

(4) ^ O 

(II JL. 
(4)_i.Tir 

(4)^ 0 

(3)_^ O 

(21 ^ □ 

(41 A 

(2) Jh- O 



(2) 
(1) 
(11 
(1) 



0 

o 



51 

52 

53 

54 

55 

56 

57 

58 

59 

60 

61 

62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 



submarine 

thermos 

projector 

group 

tackling 

transportation 

counter 

ceremony 

pod 

bronco 

directing 

funnel 

delight 

lecturer 

communication 

archer 

stadium 

excavate 

assaulting 

stunt 

meringue 

appliance 

chemist 

arctic 

(ark'-tik) (art* 



(4iiLa 

<4i 2^ A 

(3) _L_0 

(3i_L'5^r 
(ii-L_0 
(1) o 

(2i_2-_a 

(31 _^,A 

(4) ^0 
(31 J2LC? 

(21 J_0 
(3l_i_0 

(2i_2i_a 

(4l_i_ A 

(i)_^^C? 

^^)J-0 
(i)>il. O 

(3) j! □ 

(4) 2 A 

(3) JLo 



•ik) 



75 destruction (4) / 
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Answers to PEADODY Scoring Quiz 



Example 



Answer 



1. 
2. 
3. 
4. 
5. 



c 
a 
c 
b 
c 



6, 
7. 
8. 
9, 



Item 34 
Item 13 
Item 30 
Item 24 



10. 


Lo^vest 


item = 


21 


last 


item = 50 






11. 


Lowest 


item - 


25 


last 


item = 40 






12. 


Lowest 


item = 


16 


; last 


item = 31 






13. 


Lowest 


item = 


25 


; last 


item = 65 






14. 


Lowest 


item = 


1 


; last 


item = 39 






15. 


Lowest 


item = 


4 


; last 


item = 4 


(because 


the child 




had 


missed 


6 


out of 


8 between 


items 17 


and 24) 


16. 


Lowest 


item = 


1 


; last 


item = 35 







17. 



(Notice that the child never did answer 8 items 
in a row before reaching item 1. The test was 
continued, however, from item 27 until the child 
missed 6 out of 8. 

Lowest item = 1; last item = 1 
(Here is a case where the child did not get 8 in 
a row, but had missed 6 out of 8 in going back to 
item 1, I.e., between items 20 and 27. 



ERIC 

Ihmssbisss 
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remint)er: 

PEABODY Testing Procedure Possibilities 



The PEABODY is continued until a child misses 6 out of 8 successive items. 
Assuming that the child would have passed all the items 1 through 24, each 
child is started on item 25 in order to shorten the testing time. 

However, the items beginning with 25 may be too difficult for some children 
and thus a set of rules are given to cover the various conditions that can 
arise: 

BEGIN THE TEST ON ITEM 25, and 



1. If the child gets items 25 through 32 correct, 
continue the test until the child misses 
6 out of 8 items, or 



(See Quiz 
Examples 
11 and 13) 



2. If the child misses any item from 25 through 32, 
go back to item 24, then item 23, and so on, until 



a. Child gets 8 correct in a row, then 



a) Go back to the item first missed 



and continue the test until the 



(See Quiz 
Examples 



b) Discontinue the test if the child 
has already missed 6 out of 8. 



child misses 6 out of 8, or 



10 and 12) 

(See Quiz 
Example 15) 



b. You have asked items 24 through 1 and the 
child does not get 8 correct in a row, then 



a) Go back to the item firflt missed 



and continue the test until the 



(See Quiz 
Example 16) 



f>hild misses 6 out of 8, or 



b) Discontinue the test if the child 
has already missed 6 out of 8. 



(See Quiz 
Example 17) 
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HEAD START PLANNED VARIATION EVALUATION, Spring 1972 



Tester Quiz; PRE-SCHOOL INVENTORY 

Instructions: Circle "T" if the statement Is true of "F" If It Is false. 

Circle One 

1. Keep the cars, boxes, checkers, etc. on the 

table where you are testing the child. T F 

2. The first two questions on the PSI are practice Items. T F 

3. When scoring, a (v) behind the code always means that 

the child has said something. T F 

4. If to any question, the child says '*can you help me" 
and you say, *'l bet you know the answer," and then 
the child goes ahead and tells you the correct answer, 

you should circle A(v) and C(v) . T F 

5. If It Is necessary to use any additional questions, 
such as "What else do we call It?" you should 
indicate that you asked an additional question by 

"Q" In the "Child's Response column." T F 

6. When you aren't sure how to score an answer, use 

your best Judgment and score as you think It should be. T F 

7. In Question 6 you ask the child to "Put the blue car 
under the green box" and he puts the yellow car under 
the green box, you would count It as right because he 

chose the green box. T F 

8. If you ask the child to color the triangle orange , 
and he colors the square orange , you would score 

item 31 "W" and Item 32 "C". T F 

9. If you know a child's name there Is no need to check 
with the teacher to verify It or to write It in the 

''Child's Response Column." T F 
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Answers to Tester Quiz: PRE-SCHOOL INVENTORY 



I 



1* False. All material should be kept in a bag, out of sight, except when 
you are working with the material. 

2* False* There are no practice items* Rememberi howeveri that you do 
demonstrate how a swing goes (up and down and back and forth) 
before asking questions 12 and 13. 

3* True* (v) stands for verbal, which means that the child has said 
something. , 

4* False* You would only score the last answer given, in this case 
circle C(v) * 

5* True* If we see a "Q" in the "Child* s Response" column we know that 
the child did not give a complete answer in response to your 
original question, and it was necessary for you to find out 
more in order to score the item. 

6* False* When you aren't sure (and after further questioning you still 
aren't sure) write down what the child said-Q-what the child 
said in response to your additional question, and then code it 
the way you think it should be — this gives us a chance to 
agree with. your scoring or perhaps change It. 

7* False* In items 5,6, and 7, both parts must be correct* 

8« True. In items 29-20 and 31-32, the color, the shape, or both can 
be right or wrong because they are scored separately* 

9* False. Not only Is it necessary to make certain of a child's name — 
on this test you must also find out his nickname. 
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HEAD STAKT PLA.VNFl) VARIATION EVALUATION. Sprinp '12 



Tester Quiz: ETS ENUMEKATIO N 
Instructions: Circle "t" if the statement is true or if it is false. 

Circle i)no 

1. In Part A, the question **Any pointing? on the score form refers 
to the child pointing either when he is asked to COUNT THESE 
CIRCLES OUT LOUD or when he is asked NOW TELL ME HOW MANY CIRCLES 

THERE ARE. T V 

2. In Practice Item 1-A, if the child does not count the circles you 

should count them and tell him how many there are. T 

3. In Part B, when you are asked to record whether the child pointed 
from right to left or from left to right, we are referring to 

the child's right or left. T V 

4. In Part B the child is expected to touch each circle just once. 
When it is necessary to prompt him to do this, you should indi- 
cate **P" under comments for that item, T F 

5. If a child is having trouble turning the pages ''Part B), it is 

all right to help him, T F 

6. In the Part C practice item, if the child points to "b" when you 
say, PUT YOUR FINGER ON THE PICTURE THAT HAS JUST AS MANY MICE 

AS THIS ONE, you should go on to 13-C. T F 

7. In the 2 practice items of Part C, if the child has not responded 
or if he has responded incorrectly, you should show him the 

correct picture. ^ T F 

8. There are 3 "Parts" to this test: 

Part A: Counting items (items 1-4) 

Part B: Pointing to and touching items (items 5-11) 
Part C: Same number, (items 12-21) 

Same order (items 21-27) T F 

9. The Enumeration is a non-verbal test. The child is only required 

to point. T F 

10. This test should take an average of 12 to 15 minutes to complete, T F 
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Answers to Tester Qui/.; ITS KNTMIIKATION 



1. False. *Xny pointing?'* refers to only the last part of the item, 

NOW TELL ME HOW NUNY CIRCLES THEIIK ARE. 

2. False. Even if the child says nothing, you should go on to Begin 

Test . However, this is only true in Part A. You assist 
the child on the next three practice items, if necessary. 



3. 



True?, 



This is why the score form is set up so that Right-Left 
appears on your left (it is the child's right) and why 
"c b a" is indicated ( ,'ou are in reality reading ''a b c' 
upside down). 



True, 



You do not score this practice item; however fi-B through- 
11-B are scored. You should have only one respons»? checked 
for each item (except for the additional information re- 
quested for 6-B and 9-B) . If it is necessary to prompt the 
child by saying TOUCH EACH CIRCLE JUST ONCE, you should 
record "P'* on the "Comments" line and indicate what the 
child did after the prompt. 



5. 



True, 



He is expected to turn the page and touch each circle, v 
turn the page and touch each circle, etc. However, it 
is not scored as incorrect if you help him turn the 
pages. 



6. 



True, 



Whenever the child catches on you go on to the next 
request or next item. The second and third requests are 
used to help the child understand what he is to do on the 
test if he doesn't understand the first time (or the 
second time) . 



True, 



Y'ou should point to (but not count aloud) each of the three 
mice in picture "b" and then to each mouse in the top 
picture on Practice Item 12-C. You should pAint to each 
lollipop in "c" and each lollipop in the top picture in 
the same order so the child will see how they are alike. 



True, 



There are indeed 3 parts to the test; only Part C has 2 
sections: 

Same number and Same Order 



9. False. Part A is counting out loud. 

10. False. Ten minutes is estimated. 
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HEAD ST^ VARIATION EVALUATION, Spring '72 



TeiBter Qlilz; RBUBVAMT REDUNDAMT CUB (ZINGS 



LES) 



Instructions: Circli^^^^^"^^^^ stateMnt is true or 




li It the child^ i^ a row right^ 

you go on^{^^^ : ^ 

2.'' During >tb 

: V ■ ; child is 



is false. 



Circle one 



3*:,;^^^)it-.th .^e . 



fl; 



ERIC 



^vf;''*li;"^)ilsNi^ 

;.^--P6iggle^^6r!>aic?Zihgi^ 



is?" Il he 



^(iijett^; giVeSvi^^ iahd check 



ilinl^ 

-:;^:^v;^th6^:i0iB!tiv 



^correct when you 
discontinue 



you ighbuld go 



F 



F 




HEAD START PLANNED VARIATION EVALUATION, Spring 1972 



Tester Quiz; MOTCHl INHIBITION 
Instructions: Circle "t" If the statement Is true or "F" if It Is false. 

Circle one 

1. Discontinue the test If the child does not respond to the second 
part of practice trial B (demonstrating and asking him again to 
shake his head fast and slowly). T F 



2. Start the stopwatch when the first marker passes the pulley, 
record th^ time the second marker passes the pulley and stop 

the watch when the third marker passes the pulley. T F 

3. Record the time to the nearest tenth of a second on the truck 

pull. T F 

4. The first time the child winds up the truck, he is told to do 
it as quickly as he can followed by the instruction to do it 

as slowly as he can (for the 2nd trial) . T F 

5. In Practice Trial if the child ha? shaken his head Fast 
and Slow, the tester still must indicate by shaking her own 

head fast and slow how she wants the child to shake his head. T F 

6. The truck pull should be done on a table long enough to exteijd 

the cord. - T F 

7. You must be sure to start the stopwatch as soon as the child 

begins to wind the truck handle . T F 



8. Only the tester moves the pencil "slowly" and "faster" during 
practice trial A. 



T F 
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Answers to Tester Quiz; MOTOR INHIBITION 



1. 



True, 



The purpose of the practice trial, is to determine if the child 
understands the meaning of "slowly". If, after you have demons 
trated for him the shaking of head fast and then slowly, he 
is unable to show a diffe'.^tence in the speed of shaking the head 
it is best to stop the test. 



2. 



False, 



The middle mark Is on the string for an optional timing period 
not used for this testing. The stopwatch is started as marker 
1 passes the pulley and stopped when marker 3 (last one) 
passes the pull^. 



3, 



False. 



Record the time to the nearest fifth of a second, Yoiu* stop- 
watch is marked ih fifths « 



4, 



False , 



The first trial requests the child Just 
There is no instruction to get him to go "fast", 
trial does request him to go very slowly. 



"to wind it up," 



The second 



5, 



False, 



If the child shakes his head the way you asked him to, go on 
with the Truck Pull test. If the child didn/t shake his head 
the way you asked him to, or if he did not respond, you con- 
tinue with your demonstration of shaking the head "fast" and 
"slowly," 



6. 



False , 



Hie Truck Pull is done on the floor. It could be done on a 
large table, but the use of the floor permits the child to 
get up and move and thus gives him a relief from the testing 
situation. 



7. 



False, 



The stopwatch is to be started when the first nark on 
the cord passes over the pulley. If you start timing 
too soon, the child's test time will be wrongly 
increased. The reason for the twelve inches of coi'd 
before the first mark is to allow the child a short 
period to establish the speed he wishes to use. 



8* True, 
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HEAD START PLANNED VARIATION EVALUATION, Spring '72 
Tester Quiz; MOTOR INHIBITION Stopwatch Reading 



Instructions: Record the times indicated in the following stopwatch examples: 



and 



seconds fiftas 





A. 



and 



seconds fifths 




C. and 



50 



seconds fifths 




f/ AO 



D« and 



seconds fifths 
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HEAD START PLANNED VARIATION EVALUATION, Spring *72 
Tester Quiz; ITPA 
Instructions: Please circle 'V* for True or "f" for False. 



1* Since the "hail" is a practice itemi you may ask the child to TELL 
HE MORE ABOUT IT as often as needed. 

2. If the child mentions something about the "shape" of the practice 
item» you must both check that "shape" is mentioned and write in 
exactly what the child said. ' 

3. If the child gets off the subject , you should probe by saying, 
TELL HE WHAT YOU UEAN. 

4. When you present the ball to the child, it is import antTt hat you 
set it on the table so the child can get a good look at it without 
touching it. 

3* It Is OK to summarize what the child has said. 

6. If the child demonstrates a use for the "ravelope," jrou must ask 
the child to tell about the use so yon can write down his statement. 

7. After four minutes or seven statements, whichever occurs sooner, you 
may go on to the next object to be de 

8. The five principal categories into which appropriate responses fall 
are: name, color, shape, weight and material. 

9. The probes which you should use are the same for the practice item 
and the test items. 

10. If the cMld says "it (ball) looks like a brick, " you must say TELL 
ilE WHAT TOU HEAN . 

11. the pu|^^ the child with 
the test pTOcedure focus the child's attention on the 
five principal categories (name, color, shape, material and use). 

12. If the child says it (ball) is maroon, ask him for another, more 
accurate ■ color namev : 

13. If you say TELL HE WHAT TPU THINKt you imist enter a Q after the 
child's previous- statement. . 

14. Only the ball and the block can be referred* to by name by the tester. 

15. The- purpose of the ITPA is to obtain a measure of how well the child 
can express himself. 



circle 
One 

16. NR Is used to show the child made no response to your prompt on the T F 
practice Item. 

17. Indicate with (Q) If you had to ask the child WHAT IS IT MADE OF? T F 
when asking him about the ball. 

18. In the "Practice Item" section, you should read back what the child T F 
told you when you said, TELL HE ALL ABOUT THIS and what he said In 

answer to the specific prompts. 



19. Anytime you use a probe , indicate (Q) to show you questioned further. T F 

20. If the child says, "it's a long nail ," he has told you the name of T F 
it, but you would still have to ask the other four specific prompts. 

21. On the test items, continue to ask the child questions until he has T F 
told you the name, color, shape, material and use. ^ 

22. After you finish the "Practice Item," you should fold that page back T F 
so you cah*t see it. 

23. When a child begins to repeat what he has already said twice, it is T F 
time to go on to the next item. 
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Answers to Tester Quiz; ITPA 



1. False. You can say TELL ME SOMETHING ELSE or TELL ME MORE ABOUT IT no 

more than 5 times. 

2. True. Checking off the categories as the child mentions them is a 

clerical device to help you identify which categories you should 
probe further. Recording his exact answer is necessary for 
scoring the test. 

3. False. ' If the child gets off th'^ subject , the proper probe is YES, 

BUT TELL ME ABOUT THIS . 

4. False. The objects should be handed to the child. 

5. False. The exact words the child uses must be recorded. If a child is 

talking too fast, ask him to slow down, explaining that you are 
writing what he is saying. If you have missed something he has 
said, read what you have written, then pause to let him repeat 
what he said. If what he has said is not clear to you, imme- 
diately find out what he means and indicate that you had to 
question him (Q) on the score form. Each new response (word or 
statement) is written on a separate line. 



6. True. 

7. False. 

8. False. 



Here you use the probe DON*T SHOW ME. 
IT DOWN. 



TELL. ME SO I CAN WRITE 



Continue probing until the child stops talking or repeats 
himself (thriee times), or begins to get off the subject. 
Most childrm will respond for about 1 minute. 

The five principal categories are: name, color, shape, materials 
and use. Weight is not considered a principal category, but is 
considered an appropriate response as are other physical charac- 
teristics (brightness, texture, construction, etc.). 



9. False. The specific probes for the practice item concern name, color, 

shape, material and use. The specific probes for the test items 
are as follows: <^ 



If child is vague or unclear. 
If child needs encouragement. 

If child shows action. 

If child gets off the subject. 
If child repeats^ 

If child asks question , 



say TELL ME WHAT YOU 1IEAN...Q. . . 
say TELL MB SOMETHING ELSE or 

TELL HE MORE ABOUT IT. 
say DON'T SHOW HE, TELL MB SO 

I CAN WRITE IT DOWN, 
say YES, BUT TBUi ME ABOUT THIS , 
say YOU TOLD HE ABOUT THAT . NOW 

TELL HE SOHBTHING ELSE , 
say TELL HE WHAT YOU THINK. 
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9. (cont. ) 



10. True. 

11. True. 

12. False. 

13. False. 

14. False. 

15. True. 

16. True. 

17. False. 

18. True. 



r 



19. False. 



20. False. 



21. False. 



There are two general probes that can be used for the practice 
item and the test items. These are used to encourage the child 

TELL ME SOMETHING ELSE, 
or 

TELL ME MORE ABOUT IT. 
This is a case where you have to question the child further , 



entering a 
remark. 



Q to show you asked about what he meant by his 



Asking for another color name is too specific. You may, however, 
ask TELL ME MORE ABOUT IT, if the child stops talking. 

A "q" can be entered only after you have said TELL HE VTHAT YOU 
MEAN . 

Do not refer to any of the objects by name. You simply hand the 
object to the child and say TELL BIE ALL ABOUT THIS. 



If the child makes no response to your prompt on the practice 
item, enter NR. 

You never ask specific prompts during the test, the five specific 
prompts are asked only about the practice item (nail). 

You should read back what he told you without any specific questions 
and what he said when you directly questioned him about any of the 
five principal categories that he hadn*t talked about. 

The only time you use (Q) is when you had to say, TELL ME WHAT YOU 
MEAN (because his description was unclear). Remember, if the 
child's answer is unclear or confusing to 3rou, it will be Just as 
unclear or confusing to our coders. You have a chance to ask him 
what he means, 'we don't! 

He has also told yovi the shape (loRg), so you would not ask him 
WHAT SHAPE IS IT? . 

You only use the probes indicated at the bottom of each test page. 
You go on to the next object after the child stops talking, repeats 
himself three times, or gets off the subject (usually in about one 
mihute). During the **Pract ice Item** you make certain the five' 
principal categories are covered; after that the child is on his 
ownl 



22. True. This is another reminder that you use the specific prompts only 

on the practice item . F6r the test items (ball, block, envelope, 
button), use only the probes listed at the bottom of the test 

.■■■'/;._.: pages. V .^^^^ 

23. True, If y^^ ABOUT THAT. NOW TELL ME SOMETHING 

' iSSEt: repeats the same thing again, you would go on 

to *■' the''^nek:t . 



ERIC 
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HEAD START PLANNED VARIATION EVALUATION, Spring *72 

Tester Quiz; 8-BLOCK OBSERVER 
Instructions: Circle "T" if the statement is true and "f" if it's false. 



1. Be sure you have a watch oif clock with a second hand. 

2« If the mother makes 4 errors in any one Section you 

should completis the Section and then go back and repeat it* 

3* If the trainer makes an error, t^en corrects herself, it 
V is not necessary to note the error under ANY TRAINER ERRORS;' 

4. When a mother says something like "Tell me what this mark 
isV you should tally once beside MARK and once beside 
DIRECT RiKJUfOT ^ ^ 

':'5.m if: the m^^^ by colpr or shape you. 

iff^^jburi^ PE^lipO if nibthex^ sasrs to the 

r K -oliiW "Lpok at>^ these :bl^cksv top, " 

you If : thS: mother said ^ 

.: V the- s^ you would tally 

it;under.i'TE>^ '■■ ■ 



7y Soinet 

• : ^ (or the 

; ; t^ 

8. inie^^ little, O.K?" 

^ Herr!^lcL|^ : t>i^;;:'teliied 



9 In ■ PiWRt in r ^ if ; the ,cbt i^^ piteices^'?ih<^ the^ board 

( /Sy^ should have 8 4 
: ' jinl^ 

\ .; ■; ;:;bef ore0hei;\Trirf.rid^ ;4^'c^u^b8ti.6n my-'-X'-^-'-'-. 



If 



^ 1^ be 

:v'^'--5?S^^'^^^ instance^ if'\ 




' 1: S;^^ 'sHbuldn !:t: ei rcl#^ anjy^ ^ huiirt)et WITHii 



Circle one^ 



ERIC g||iiKftSlg^giii^ 



Answers to Tester Qulzt 8-BLOCK OBSERVER 



1. True. The time It takes to train the mother » the time spent 

in orientation, and the time spent in training the 
child should be timed separately . 

2. True. In fact, if the mother mkkes 2 or more errors the 

Section should be repeated. 

3. True. Only if the Observer doesn't clue the Trainer quickly 

enough to catch an error should that error be explained. 

4. False. You only tally under MARK or DIRECT REQUEST not both. 

this particular example would be tallied under MARK 
in ORIENTATION and uh^ TAUCING:) MARK in 

TRAINING. 



5. True. if the Chi W you would tally 

under RESPOND or COMIflENTS,^^^^^^P on the situation. 

■ ^or example:''.' 

^ r Mother says -'What color is this block?" (TASK IRRELEVANCY) 



Child says "Red^ 



(RESPOND) 



; v^^^^ V Mbttiei-^ together" (REQUEST PLACING: 

'^^ "■' ■ /v / ■•\;HEI(MT) : 

^ are nice" (COMMENTS, PIAY) 

6. Triiei. ■ ilkik FOR PLACING AND 

7. ;' r PttJ^sei. \ ^ lif^\thiWihai^ f 0r^seyeIat secsoh^ 

■' •"iv^:.- ' -/r'-^^*^!-!^^^^^^ ;iinder,^pBSKWE. • ; ■ ' 



8. 



9. 



Flilae. : /Her las under PRAISE. 

V v ^ ;;if^ the^ f ine'V etc. it 



True^: 



tony f pira 

suich^s^ blank. 
We canity 

had hb i^ should have 

iwrittOTL;:^ 
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HEAD START PLANNED VARIATION EVALUATION . Spring '72 
Tester Quiz; S-BLOCK TRAINER 

Instructions: Circle if the statement is true and "F'' if it's false. 

Circle one 

1. It doesn't matter how you teach the mother the 

8-Block Sort task as long as she understands it. T F 

2. If you forget to teach the mother one of the 

sections just go on and complete the instructions. T F 




3. Rather than cause an awkward period of silence 
it is better to immediately tell the mother the 
answer. 

4. If it is necessary to say to the mother "isn't 
there something wrong with this group?" you would 
count this as "help." 

5. Keep .going through an entire Section before repeat- 
ing. 

6. If the mother has made 1 mistake you should go 
back and repeat the entire Section. 

7. In Sections 3 and 4 the mother must indicate both 
height and mark in order to be considered correct. 

8. It is important to have the child's full attention 
before you ask him to place the blocks, 

9. It doesn't matter how the blocks are arranged on 
the board, when you ask the child to place the 
"OTHER" blocks. 



10, If the mother is not completing the Parent Information 
Form you should take it from her and seal it in an 
envelope. T F 

11. You should keep saying, "You're doing very well," 
"That's good," to all mothers while they are learning 

the task. T F 
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Answers to Tester wulz; 8-BLOCK TRAINER 



1* False* 

2. False* 

3. True. 

4. True. 

5. True. 

6. False. 

7. True. 

8. True. 

9. False. 

10 « False. 

11. False. 



Each mother should be taught in exactly the same way and 
given the same information. How she teaches her child 
will vary. 

You and the observer should work out some kind of signal 
so you know if you have skipped any part of the teaching. 
If you have overlooked a part, go back and teach the mother. 
The observer will note this on the score form. 

If the mother doesn't correct herself immediately you 
should tell her the answer. We should try not to frustrate 
her by giving her the feeling we are testing her. 

Even if she corrects herself this would be considered as 
**help." If necessary, keep a count on your fingers so you 
will know if you should repeat a Section. 

Regardless of how many times you have to help the mother, 
go through the entire Section before starting over. 

She needs to make 2 mistakes before you repeat the Section. 
However, remember that if she places a small block with the 
large blocks and a large block with the small blocks this 
would be considered 2 mistakes. 

If the mother mentions only one way the blocks are alike, 
you should give her a reminder by saying, **And../* So far 
she has not made a mistake and if she does indicate that 
they are alike in the other way (Tall with an X, Short with 
an 0, etc.) you would not consider this a mistake. However, 
if you have to tell her the other way in which they are 
alike you should consider this an error. 

Some of these children are very shy so it is important to 
gain his confidence and his attention before requesting that 
he place the blocks. 

The 8 original blocks should be arranged in 4 groups and the 
extra blocks should be put out of sight before you present 
him with the first "OTHER** block. 

If a mother seems to be having trouble with the form, offer 
to help her. 

Some mothers would be highly insulted if you kept praising them 
for being able to perform a task that will ..next be presented to 
a 4 year old.* Use these encouragements only if you feel the 
mother needs them. Some mothers will catch on immediately and 
will go ahead and tell you how the groups are alike without 
your having to ask. If they say that they have the idea after 
you have explained ''height** simply explain that you are supposed 
to go through these various sections with each mother, but that 
you can go through them quickly. This will vary by mother, 
obviously. 
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Appendix J 
SRI FIELD SaPERVISOR SITE REPORT FORMS 
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SRI FIELD SUPERVISOR SITE REPORT FORMS 
CONTENTS 

Fall 1970 J-5 

Spring 1971 J-6 

Fall 1971 J-7 

Spring 1972 J-12 



FIELD SUPERVISOR CHECK LIST 



Fall 1970 



Site Date(s) 

Field Supervisor \ 

I* Head Start Director; 

A* Did you meet HS Director? Yes No 

B* Did you only talk over phone with HS Director? Yes No 

C. Did the HS Director mention any problems? Yes No 

D. If yes, explain: 



**E. Check with HS Director our list of "their" classes? Yes No 

F. Did HS Director give approval for Ethnic Heritage tests to be given 
to children? Ye s No 

G* If approved, how many classes did Director approve for the administration 
of the tests? 



II. Site Coordinator: - 

A. Did you visit the centers with the Site Coordinator? Yes No 

B. If no, explain: 



C* How were the tests going? 



D. Did you check if Random Permutation table was being used? Yes No 

E* Did you check the Classroom Information Form to see if the children's 
names entered there correspond to children taking the tests? Yes No 

F. Did you ask to meet any of the testers? Yes No 

0* If no, explain: 



III. Any problems in the community? Yes No 
If yes, vSiat are they? 
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8071 
Sept. 1970 



Sprin(; 1971 



SRI HEAD START FIELD SUPERVISOR 
SITE REPORT 

Site ■ Dates Visited_ 

SRI Field 

Supervisor Sponsor 



1. Perii^ons (including testers) contacted: 



Name Title In By 
Person/Phone 



Site Coordinator / 



Head Start Director 



2. Scheduling 

a) Available testing time: 



b) A,M, or P.^T, CA^:^sses, or both?^ 

c) Snack and lunch times: 



/ 



d)Closed on certain days during testing (holidays, etc.) Please specify. 



3. Visit Head Start centers with Site Coordinator? Yes No 

With other person? Name 



Number of schools included in visits 



SRI Head Start Field Supervisor 
Site Report - Page 2 



4. Problem areas: (check as required) 



a. 


proper use of tests to be administered 


h. 


acceptance of testing by: 


b. 


testers procedures checked 




1) HS director 


c. 


facilities 




2) teachers 


d. 


test conditions 




3) children 


e. 


scheduling 


i. 


program issues 


f. 


field staff checked 


J. 


contact and coordination with 




any schools not visited 




sponsor by HS director 






k. 


community 



If you have checked any of the areas above, please elaborate below. 



5, Veflfy nunbef of clasBes and tines against your copy of "Number of classes and 
tltoes ' urtdfer "Class lists, etc." in P.S. notebook. 



Fall 1971 



SRI HEAD START FIELD SUPERVISOR 
SITE REPORT 

Site Dates Visited 

SRI Field 

Supervisor Sponsor 



1. Persons Contacted (including testers): 

In By 

^^^^^^^^^^^^^^^^ ^^^^^^111^^=^—— Person? Phone? 

Site Coordinator 



Head Start Director 



2* Check our list of classes to be tested with Head Start Director? 

Yes No (Please note any discrepancies on your copy.) 

3* a) Classes start: . 

Classes end : 

Available testing time; 

b) A.M. or P.M. classes, or both? 

c) Year-round or 8-month, etc. , program? (Please specify* ) 



d) Closed any certain days, etc*? (Please specify*) 



4. Check proper use of Permutation Table (including its use with Classroom 
Information Form)? Yes No 

\ 

5. Visit Head Start centers with Site Coordinator? Yes No 

If any missed, please explain: 



If yes, how? / If no, why not? 



BBT 
BBT 
BBT 
SBT 
SBT 
Brown 



Check testers on test procedures: 

Checked 

. Name ■_ Yes/No 

BBT 



7. Testing: 

a) What type of facilities? * 



b) Generally, what were the over-*all conditions of testing? 
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7. Testing (cont'd) 

c) Your Evaluation of Field Staff: 

^■^K^^^iSS^BBBBK^^Ba s^BM^ s^f^isa iS^SlMSS Unacceptable 

(MT) ~ 

(MT) 

Tmt) 

(BBT) ■ ~ 

(Brown Tester) 

(SET) [ 

(8-Blk. Observer) 

(8-Blk. Observer) ~ 

(8-Blk. Trainer) 

(8-Blk. Trainer) 

(SC's Aide) \ 

d) Acceptance of testing by; 
Head Start Director 



Teachers 



Children 



J-10 



8. Program issues (competence, motivation, cooperation with PV, SRI): 
a) Head Start Director 



b) PAC Chairman 



c) Teachers 



9. Amount of contact and coordination with the Sponsor by Head Start Director: 



10. Community problems (funding, power struggles, etc. ) : 



11. Himcellaneous comments: 



J-11 



SPRING 1972 

SRI HEAD START FIEU) SUPERVISOR 
6ITE REPORT 

Site Dates Visited 



SRI Field 

Supervisor Slpbnsor 



1. Persons Contacted (Including testers); 

Name Title 



In By 
Person? Phone? 



Site Coord Ina t or 



Head Start Director 



Principal ' 

List any additional testers on back, including full information. 

2. Verify number of classes and times against your copy of "Number of classes and 
times** under "Class lists, etc/* in F.S. notebook. 

9m Scheduling 

a) Available testing time: 

b) A.M. or P.M. classes, or both? ^ 

c) Snack and lunch times; 

d) Schedule difficulties; 

e) Closed on certain days during testing (holidays, etc.) Please specify. ' 



.347 



'I. Check proper use of "Tests to be Administered"sheets (Class Lists)? 

Yes No (note any discrepancies on your copy.) 



With other person: 

5. Visit Head Start centers with Site Coordinator? Yes No / Name 

Number of schools included in visits 

If any mlssea, please explain: 



6. Check testers on test procedures: 

Checked 

Name Yes /No If yes, how?/ If no, why no t. ? 



BBT 
BBT 



BBT 
BBT 
SBT 
SBT 
Brown 



4- 



List additional testers on back: 
Include full information. 

7. Testing; 

a) What type of facilities? (description of testing space and arrangement.) 



b) Generally, what were the over-all conditions of testing? (problems ^ good poin ts, etc) 
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Testirg 

c) Ycur Evaluation of Field Staff: 

Above 

Name Expert i Average Average Borderline Unacceptable 



(BBA) I 

t 

(BBA) 



(BBA) 



(BBA) 



(BBB) 



(BBB) 



(BBB) 



(BBB) 



(Brown Tester )- 



(SBT) 



(SBT) 



(8-Blk. Observer) 
(8-Blk. Observer) 



(8-Blk. Trainer) 
(8-Blk, Trainer) 



(SC*8 Aide) 



d) Acceptance of testing by: 

Head Start Director 



Teachers 



Oiildren 



8* Program issues (compelenco, motivation, cooperation with PV, SRI): 
a) Head Start Director • 



b) PAC Chairman 



c) Teachers 



9* Amount of contact and coordination with the Sponsor by Head Start Director: 



10. Community problems (funding, power struggles, etc.): 



11. Miscellaneous comments: 
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